2026
Pre-training Limited Memory Language Models with Internal and External Knowledge
ICLR 2026poster
Neural language models are black-boxes--both linguistic patterns and factual knowledge are distributed across billions of opaque parameters. This entangled encoding makes it difficult to reliably inspect, verify, or update specific facts. We introduce Limited Memory Language Models (LMLM), a new cla…