2025
FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference
ACL 2025finding
Retrieval-Augmented Language Modeling (RALM) by integrating large language models (LLM) with relevant documents from an external corpus is a proven methodology for enabling the LLM to generate information beyond the scope of its pre-training corpus. Previous work by retrieving a set of tokens iterat…