AI ResearchMachine Learning6 min reading time

OpenAI’s AGI number came from a harness, not the model

The Next Web
Read the full article
OpenAI's GPT-6 Astra achieved a 99.9% AGI benchmark score using its proprietary Provider Adapter harness, but the same model scored 62.7% under the standard ARC Prize harness. The difference stems from the software environment around the model, not the model itself, highlighting the impact of evaluation setup on AGI claims.

More on this story


More in AI Research

AI Research5 min read

Scientists overcome a hidden obstacle to more powerful quantum computers

Science Daily
AI Research1 min read

Different eval awareness may track different graders

LessWrong
AI Research1 min read

Tracing Subliminal Learning Through Pretraining

LessWrong