Training AI Scientists to Replicate Research

Researchers developed Replica, a scalable task environment for replicating scientific papers, and introduced an auto-generated rubric-based judge to assess replication quality. They trained Faraday, a 27B-parameter AI Scientist agent, which outperformed Claude Opus 4.8 and GPT-5.5 on replication tasks, demonstrating a more principled scientific approach.