Ziwen Xia

FACT: Examining the Effectiveness of Iterative Context Rewriting for Multi-fact Retrieval

Large Language Models (LLMs) are proficient at retrieving single facts from extended contexts, yet they struggle with tasks requiring the simultaneous retrieval of multiple facts, especially during generation. This paper identifies a novel “lost-in-the-middle” phenomenon, where LLMs progressively lo…