How much does a code model know about what the code does?
June 14, 2026
A progress report on a side project: I built a small pipeline to read the hidden states of code models, then probed four sizes of Qwen2.5-Coder. Scale makes them settle the grammar earlier in the network and barely changes how well they track what a program does.
interpretability llms code