He Wants AI Benchmarking To Be a Science, Not a Dark Art

Moritz Hardt critiques AI benchmarks as fundamentally flawed yet influential in driving AI progress. He argues that benchmarks have been broken for decades, enabling models to game leaderboards without true intelligence. His 2026 book calls for reforming benchmarking into a rigorous science.