LiuYiBo LiuYiBo

Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training

While large language models (LLMs) are equipped with longer text input capabilities than before, they are struggling to seek correct information in long contexts. The “lost in the middle” problem challenges most LLMs, referring to the dramatic decline in accuracy when correct information is located…