Hessian-Enhanced Token Attribution (HETA): Interpreting Autoregressive LLMs
Attribution methods seek to explain language model predictions by quantifying the contribution of input tokens to generated outputs. However, most existing techniques are designed for encoder-based architectures and rely on linear approximations that fail to capture the causal and semantic complexit…