2025
Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
EMNLP 2025
Large language models (LLMs) often fail to scale their performance on long-context tasks performance in line with the context lengths they support. This gap is commonly attributed to retrieval failures—the models’ inability to identify information in the long inputs that is relevant to the task they