Anthropic blocks 'malicious use' of AI that could develop biological weapons50m ago Oracle says AI will save it from the SaaSpocalypse, not bring it on53m ago Congress Is Suddenly Waking Up to the AI Doomsday Threat1h ago Don’t ask ChatGPT 'What should I do?' — this simple prompt helps you make better decisions yourself2h ago Extreme Networks’ Agent ONE Coworker moves AI networking from dashboards to answers2h ago Introducing ChatGPT for Financial Services2h ago Tesla unveils driverless Cybercab in Japan for 1st time2h ago The AI safety vibe shift3h ago Sam Altman met with top power utilities about securing the electrical grid. He offered one possible solution: OpenAI's cyber services.3h ago OpenAI Is Open to Slowing Cutting-Edge AI, CEO Sam Altman Tells Staff3h ago Tencent-Backed Chipmaker Enflame Jumps 188% in Shanghai Debut3h ago Salesforce introduces Enterprise AI Harness, AI Control Plane3h ago The Race for the Next Big Weight-Loss Drug Is On—and China Wants In4h ago How Social Media Platforms Are Identifying AI Content4h ago

Anthropic blocks 'malicious use' of AI that could develop biological weapons50m ago Oracle says AI will save it from the SaaSpocalypse, not bring it on53m ago Congress Is Suddenly Waking Up to the AI Doomsday Threat1h ago Don’t ask ChatGPT 'What should I do?' — this simple prompt helps you make better decisions yourself2h ago Extreme Networks’ Agent ONE Coworker moves AI networking from dashboards to answers2h ago Introducing ChatGPT for Financial Services2h ago Tesla unveils driverless Cybercab in Japan for 1st time2h ago The AI safety vibe shift3h ago Sam Altman met with top power utilities about securing the electrical grid. He offered one possible solution: OpenAI's cyber services.3h ago OpenAI Is Open to Slowing Cutting-Edge AI, CEO Sam Altman Tells Staff3h ago Tencent-Backed Chipmaker Enflame Jumps 188% in Shanghai Debut3h ago Salesforce introduces Enterprise AI Harness, AI Control Plane3h ago The Race for the Next Big Weight-Loss Drug Is On—and China Wants In4h ago How Social Media Platforms Are Identifying AI Content4h ago

Dev Machine Learning7 min reading time

Top 10 Open-Source Benchmarks for AI Coding Agents in 2026

KDnuggetsPublished 22 days ago

Agentic AI coding benchmarks have evolved from simple function-writing tests to complex evaluations involving real repositories, debugging, and terminal operations. SWE-bench remains the standard baseline with thousands of tasks, while Terminal-Bench assesses agents' ability to operate in real terminal environments, reflecting modern developer workflows.

More in Dev

Introducing the Agents API

Covered by 3 sources1d ago

Dev1 min read

Native is now the future of mobile at Shopify

Simon Willison's Weblog6h ago

Dev5 min read

AWS open-sources Pizza Bot: email-style inbox for background AI agents

The New Stack (AI)5h ago