2025
Order-Level Attention Similarity Across Language Models: A Latent Commonality
NeurIPS 2025poster
In this paper, we explore an important yet previously neglected question: Do context aggregation patterns across Language Models (LMs) share commonalities? While some works have investigated context aggregation or attention weights in LMs, they typically focus on individual models or attention heads…