StateBench: Testing how language models track state changes over long documents

StateBench is a new benchmark designed to evaluate how well language models track evolving information about entities in long documents. It reveals that recurrent and hybrid models outperform transformers on complex state-tracking tasks, though leading models like Gemini 3.8 Flash and GPT-6 Sol struggle with harder cases as input length increases.