2025
SEAL: Scaling to Emphasize Attention for Long-Context Retrieval
ACL 2025long
While many advanced LLMs are designed to handle long sequence data, we can still observe notable quality degradation even within the sequence limit. In this work, we introduce a novel approach called Scaling to Emphasize Attention for Long-context retrieval (SEAL), which enhances the retrieval perfo…