Shock horror — AI-generated security patches fall short of actually solving all the problems they were meant to fix

Researchers at 1Password's Off-by-1 Labs evaluated AI-generated security patches from ChatGPT 5.5 and Claude Opus 4.8 on six CVEs, finding only 26% fully fixed issues. Many patches failed, altered behavior, or introduced new vulnerabilities, but proper guidance improved success to 65%.