2025
Lost in the Distance: Large Language Models Struggle to Capture Long-Distance Relational Knowledge
NAACL 2025findings
Large language models (LLMs) have demonstrated impressive capabilities in handling long contexts, but challenges remain in capturing relational knowledge spread far apart within text. Connecting long-distance knowledge is important for solving tasks as the context length increases: imagine reading a…