Presentation: From AI Agent Demo to Production: Automated Testing and Evaluation

Zhou Yu, co-founder of Arklex AI and Columbia professor, discusses the challenge of moving AI agents from demos to production, focusing on simulation-driven testing and improvement. He highlights consumer-facing conversational agents like Walmart's Sparky and Amazon's Rufus, which assist users in e-commerce by answering specific product questions.