2025
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
ACL 2025long
Large language models (LLMs) face significant challenges in handling long-context tasks because of their limited effective context window size during pretraining, which restricts their ability to generalize over extended sequences. Meanwhile, extending the context window in LLMs through post-pretrai…