2025
Great Memory, Shallow Reasoning: Limits of kNN-LMs
NAACL 2025short
K-nearest neighbor language models (kNN-LMs), which integrate retrieval with next-word prediction, have demonstrated strong performance in language modeling as well as some downstream NLP benchmarks. These results have led researchers to argue that models trained on poor quality or outdated data cou…