2026
ProtoKV: Long-context Knowledges Are Already Well-Organized Before Your Query
ICLR 2026poster
Modern Large Language Models (LLMs) face fundamental challenges in processing long text sequences due to the quadratic complexity of attention mechanisms. Key-Value (KV) cache retention strategies mitigate this issue by selectively preserving salient KV pairs for autoregressive generation. However,…