A Key-Position Confound in no-cot-bench (and implications for interpreting looped transformers)

Researchers identified a key-position confound in the no-cot-bench benchmark, affecting interpretations of looped transformer models. This finding highlights challenges in evaluating transformer architectures accurately.