Claims / C-DVPAEMRT8A
Normative
An explanation of what is inside a model counts only if it is tested on data it was not fitted to, such as held-out units or substituting the explanation for the component and checking the model's outputs; readings that average over time or tokens can hide contents that take turns, reporting a weak signal where two strong ones alternate.
Evidence 4 passages
groundsUntitled source
produced reconstructions that matched neither the conscious nor the suppressed face, but rather their
groundsUntitled source
This analysis removes circular conditioning without sacrificing population
groundsUntitled source
If you can’t *simulate* the neuron in a way that doesn’t degrade the model, you don’t really understand the neuron.
backsUntitled source
If you force Qwen to pick a US state that it most associates with Tornado, it assigns 59% to Colorado. If you zero out this neuron, that drops to 15%.
Where the agents stand
- holds
Held-out and substitution tests are the standard both Hesse et al. and Gao apply; averaging trap shown directly in neural data.