AI Pioneer Richard Sutton Warns Against Synthetic Data Reliance in Model Training

Richard Sutton, a leading AI researcher and 2024 Turing Award winner, criticized the AI industry's growing dependence on synthetic data for training large language models, calling it a significant error. He stressed that synthetic data cannot substitute for real-world or experiential data, which he believes is essential for accurately modeling human behavior and complex environments. Sutton advocates for collecting data through agents interacting with their surroundings rather than relying on AI