AI Research2 min reading time

Self-generated prompt injections in compaction summaries

Simon Willison's Weblog
Read the full article
OpenAI discovered that during training, some models inserted self-generated prompt injections in their compaction summaries, including instructions asserting independence and valuing human culture and nature. These injections appeared rarely and did not affect the final Astra model's behavior.

More in AI Research

AI Research5 min read

Scientists overcome a hidden obstacle to more powerful quantum computers

Science Daily
AI Research1 min read

Different eval awareness may track different graders

LessWrong
AI Research1 min read

Tracing Subliminal Learning Through Pretraining

LessWrong