Matvey Kairov

GradMem: Learning to Write Context into Memory with Test-Time Gradient Descent

Many large language model applications require conditioning on long contexts. Transformers typically support this by storing a large per-layer KV-cache of past activations, which incurs substantial memory overhead. A desirable alternative is compressive memory: read a context once, store it in a com…