The Quest for Embedded Evaluators

Anthropic and OpenAI have committed to embedding independent evaluators within their organizations to provide oversight and external perspectives on AI development, but challenges remain in finding qualified, trustworthy evaluators without conflicts of interest. A group of AI experts has outlined minimum standards for such evaluators to ensure independence and transparency.