Anthropic Publishes Guidance for More Reliable AI Safety Evaluations

Anthropic released detailed guidance on AI safety evaluations, highlighting multi-turn testing methods that better capture conversational risks and recommending domain-expert scenario design and automated grading. Their tests show recent models achieve 94%-98% harmless-response rates in single-turn API checks, emphasizing the need for nuanced, context-aware safety assessments.