Helping AI text detectors keep up with changing conditions

MIT AI News
Read full story· 6 min
Researchers from MIT and Cornell developed a test-time adaptation technique that significantly improves AI-generated text detectors' accuracy and resilience against disguised AI writing, achieving 93% detection versus 27% for existing tools. This method helps adapt detectors to evolving writing styles and new language models without retraining from scratch, aiding educators and cybersecurity experts in identifying AI-generated content.

What happened

Researchers at MIT and Cornell University created a new method called test-time adaptation to improve the accuracy of AI-generated text detectors. This technique allows detectors to adjust to new writing styles and disguised AI text without needing to be retrained from scratch. In their experiments, the new method identified 93% of disguised AI-generated text, compared to 27% for existing detection tools. The research will be presented at the Conference on Neural Information Processing Systems.

Key details

  • Test-time adaptation enables detectors to learn from new, unlabeled data after deployment.
  • The method achieved 85% accuracy on naturally shifting human language, versus 73% for traditional methods.
  • The study involved researchers Manish Raghavan (MIT), Kevin Ren (Cornell Tech), and Nikhil Garg (Cornell Tech).
  • Current commercial detectors struggle with disguised AI text, often missing over 70% of such cases.
  • The technique helps detectors keep up with both evolving writing styles and new language models.

Why it matters

Educators, editors, publishers, and hiring managers can more reliably identify AI-generated writing, even when efforts are made to disguise it. Cybersecurity professionals gain a stronger tool for detecting AI-generated phishing emails or fraudulent content. This reduces the risk of AI-generated text being misrepresented as human-written, helping organizations maintain trust and integrity in written communications.


More in AI Research