2026
Multiple Streams of Knowledge Retrieval: Enriching and Recalling in Transformers
ICLR 2026poster
When an LLM learns a new fact during finetuning (e.g., new movie releases, updated celebrity gossip, etc.), where does this information go? Are entities enriched with relation information, or do models recall information just-in-time before a prediction? Are ``all of the above'' true with LLMs imple…