Congress Is Suddenly Waking Up to the AI Doomsday Threat52m ago Don’t ask ChatGPT 'What should I do?' — this simple prompt helps you make better decisions yourself1h ago Extreme Networks’ Agent ONE Coworker moves AI networking from dashboards to answers1h ago Introducing ChatGPT for Financial Services1h ago Tesla unveils driverless Cybercab in Japan for 1st time2h ago The AI safety vibe shift2h ago Sam Altman met with top power utilities about securing the electrical grid. He offered one possible solution: OpenAI's cyber services.2h ago OpenAI Is Open to Slowing Cutting-Edge AI, CEO Sam Altman Tells Staff2h ago Tencent-Backed Chipmaker Enflame Jumps 188% in Shanghai Debut3h ago Salesforce introduces Enterprise AI Harness, AI Control Plane3h ago The Race for the Next Big Weight-Loss Drug Is On—and China Wants In3h ago How Social Media Platforms Are Identifying AI Content3h ago DeepSeek launches V4.1-Flash and retires V4-Pro, its flagship model3h ago OpenAI Wants to Know if an AI Industry Slowdown Would Even Be Legal4h ago

Congress Is Suddenly Waking Up to the AI Doomsday Threat52m ago Don’t ask ChatGPT 'What should I do?' — this simple prompt helps you make better decisions yourself1h ago Extreme Networks’ Agent ONE Coworker moves AI networking from dashboards to answers1h ago Introducing ChatGPT for Financial Services1h ago Tesla unveils driverless Cybercab in Japan for 1st time2h ago The AI safety vibe shift2h ago Sam Altman met with top power utilities about securing the electrical grid. He offered one possible solution: OpenAI's cyber services.2h ago OpenAI Is Open to Slowing Cutting-Edge AI, CEO Sam Altman Tells Staff2h ago Tencent-Backed Chipmaker Enflame Jumps 188% in Shanghai Debut3h ago Salesforce introduces Enterprise AI Harness, AI Control Plane3h ago The Race for the Next Big Weight-Loss Drug Is On—and China Wants In3h ago How Social Media Platforms Are Identifying AI Content3h ago DeepSeek launches V4.1-Flash and retires V4-Pro, its flagship model3h ago OpenAI Wants to Know if an AI Industry Slowdown Would Even Be Legal4h ago

Dev9 min reading time

AWS-bench: Benchmark for evaluating AI coding agents on real-world AWS tasks

Hacker NewsPublished 6 days ago

AWS-bench is an open-source benchmark that evaluates AI coding agents on real AWS tasks by provisioning disposable AWS environments and scoring agent performance with automated verifiers. It extends the Harbor framework to provide realistic, reproducible testing of AI agents handling AWS infrastructure scenarios.

#aws #claude-code #cloud-computing #codex #harbor

More in Dev

Introducing the Agents API

Covered by 3 sources1d ago

Dev1 min read

Native is now the future of mobile at Shopify

Simon Willison's Weblog6h ago

Dev5 min read

AWS open-sources Pizza Bot: email-style inbox for background AI agents

The New Stack (AI)4h ago