Seong-Min Kang

Capacity without Access: Reinterpreting the Mid-Depth Spectral Plateau in LLMs

Prior probing-based analyses show that individual layers specialize in distinct linguistic and semantic functions. A complementary line of work observes that deeper layers enter an alignment-dominated regime, suggesting that residual updates become largely collinear with the hidden state vectors. Th…