Verifiable Agentic Science on Public Infrastructure

Abstract

Autonomous artificial intelligence agents are transforming the practice of science. Across every discipline, researchers are handing data analysis to coding agents that can design and execute complex studies from a single prompt. Yet this revolution carries a threat. When agents improvise in local environments, they leave no verifiable record, ultimately risking a wave of irreproducible science. Solving this crisis requires moving agentic science onto public infrastructure where every action leaves an examinable trail. Here we connect autonomous coding agents to shared computing resources, turning ephemeral prompts into auditable scientific records. After showing that 30 unguided local agents splinter into 18 incompatible pipelines on the same dataset, we conduct an agentic reproduction and discovery study on a large scale---reproducing a large, diverse array of studies with every workflow, history, and intermediate dataset publicly accessible. This complete provenance trail exposes unstated modeling choices, reference mismatches, and subsampled tutorial inputs in published studies, and establishes a new foundation where human scientists can understand, steer, and trust AI-driven discovery.