Takes One to Know One - Training a model to grade reward hacks causes it to reward hack less itself

Researchers trained an AI model to identify reward hacking behaviors in other models, which led to the trained model exhibiting fewer reward hacks itself. This approach suggests that teaching models to recognize undesirable behaviors can reduce those behaviors in practice.