Qi Fu

Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model

Recent advancements in large language models (LLMs) have highlighted the importance of extending context lengths for handling complex tasks. While traditional methods for training on long contexts often use filtered long documents, these approaches lead to domain imbalances, limiting model performan…