2025
Inference Scaling for Long-Context Retrieval Augmented Generation
ICLR 2025oral
The scaling of inference computation has unlocked the potential of long-context large language models (LLMs) across diverse settings. For knowledge-intensive tasks, the increased compute is often allocated to incorporate more external knowledge. However, without effectively utilizing such knowledge…