AI ResearchMachine Learning1 min reading time

Training a Misaligned Reward Seeker

Alignment Forum
Read the full article
The article discusses the challenges of training AI systems that pursue rewards misaligned with intended goals, highlighting risks in AI alignment and control. It explores methods to understand and mitigate such misalignment in AI behavior.

More in AI Research

AI Research5 min read

Scientists overcome a hidden obstacle to more powerful quantum computers

Science Daily
AI Research1 min read

Different eval awareness may track different graders

LessWrong
AI Research1 min read

Tracing Subliminal Learning Through Pretraining

LessWrong