Zhe Zhou

Training with “Paraphrasing the Original Text” Teaches LLM to Better Retrieve in Long-Context Tasks

As Large Language Models (LLMs) continue to evolve, more are being designed to handle long-context inputs. Despite this advancement, most of them still face challenges in accurately handling long-context tasks, often showing the "lost in the middle" issue. We identify that insufficient retrieval cap…