2025
Value-Guided KV Compression for LLMs via Approximated CUR Decomposition
NeurIPS 2025poster
Key-value (KV) cache compression has emerged as a critical technique for reducing the memory and latency overhead of autoregressive language models during inference. Prior approaches predominantly rely on query-key attention scores to rank and evict cached tokens, assuming that attention intensity c…