Updates on AI Evaluation

Every AI story we track on AI Evaluation: 12 stories so far, each summarized in our own words and linked to the publisher that reported it.

Pulled from 125 sources

This week

AI Research7 min read

New paper: Emerging trends in AI agent evaluation

AI Snake Oil6d ago

This month

Business & Enterprise5 min read

Arena Secures $200M Series B at $3.1B Valuation to Advance AI Evaluation

Unite.AI18d ago

Healthcare9 min read

The Reliability Layer for Healthcare AI: Common LangSmith Use Cases

LangChainSep 22

Business & Enterprise5 min read

Anthropic is paying the firm that will evaluate it, and says in the same announcement that this is not how it should work.

The Next WebSep 19

Cybersecurity13 min read

Simon Edwards, CEO and Founder of SE Labs – Interview Series

Unite.AISep 14

AI Research5 min read

Five AI systems, one message: one cloned the repo and ran the check

Hacker NewsSep 3

Agents4 min read

Introducing Rubrics: Build Agents that Evaluate and Correct Their Work

LangChainAug 25

AI Research1 min read

MUD as AI Evaluation and LLM-judge distortion in ways aggregate κ misses

LessWrongAug 2

AI Research1 min read

Do your capabilities homework

LessWrongAug 1

Cybersecurity5 min read

OpenAI and Hugging Face partner to address security incident during model evaluation

Open AI NewsJul 21

EVA-Bench Data 2.0: 3 Domains, 121 Tools, 213 Scenarios

Hugging FaceJun 4

Machine Learning

AI evals are becoming the new compute bottleneck

Hugging FaceApr 29

That's everything we have on AI Evaluation right now