2026
CoMem: Context Management with A Decoupled Long-Context Model
ICML 2026poster
Context management enables agentic models to solve long-horizon tasks through iterative summarization of previous interaction histories. However, this process typically incurs substantial decoding overhead for the extra summarization tokens, which significantly affect the end-to-end response latency…