2025
Layer by Layer: Uncovering Hidden Representations in Language Models
ICML 2025oral
From extracting features to generating text, the outputs of large language models (LLMs) typically rely on their final layers, following the conventional wisdom that earlier layers capture only low-level cues. However, our analysis shows that intermediate layers can encode even richer representation…