J-Lens can't detect what a subliminal learning teacher is transmitting (in 7B-32B models)
LessWrong
Read the full articleResearchers found that the xJ-Lens interpretability tool fails to detect the information transmitted by a subliminal learning teacher in language models ranging from 7 billion to 32 billion parameters. This suggests limitations in current interpretability methods for understanding subtle knowledge transfer in large models.