2026
Multiple Token Divergence: Measuring and Steering In-Context Computation Density
ICLR 2026poster
Measuring the in-context computational effort of language models is a key challenge, as metrics like next-token loss fail to capture reasoning complexity. Prior methods based on latent state compressibility can be invasive and unstable. We propose Multiple Token Divergence (MTD), a simple measure of…