Neuromem: A Granular Decomposition of the Streaming Lifecycle in External Memory for LLMs
Most evaluations of External Memory Module assume a static setting: memory is built offline and queried at a fixed state. In practice, memory is streaming: new facts arrive continuously, insertions interleave with retrievals, and the memory state evolves while the model is serving queries. In this r…