2025
Long-Short Alignment for Effective Long-Context Modeling in LLMs
ICML 2025poster
Large language models (LLMs) have exhibited impressive performance and surprising emergent properties. However, their effectiveness remains limited by the fixed context window of the transformer architecture, posing challenges for long-context modeling. Among these challenges, length generalization…