COLING 2025main1 citations

Citation Amnesia: On The Recency Bias of NLP and Other Academic Fields

Jan Philip Wahle, Terry Lima Ruas, Mohamed Abdalla, Bela Gipp, Saif M. Mohammad

Abstract

This study examines the tendency to cite older work across 20 fields of study over 43 years (1980–2023). We put NLP’s propensity to cite older work in the context of these 20 other fields to analyze whether NLP shows similar temporal citation patterns to them over time or whether differences can be observed. Our analysis, based on a dataset of ~240 million papers, reveals a broader scientific trend: many fields have markedly declined in citing older works (e.g., psychology, computer science). The trend is strongest in NLP and ML research (-12.8% and -5.5% in citation age from previous peaks). Our results suggest that citing more recent works is not directly driven by the growth in publication rates (-3.4% across fields; -5.2% in humanities; -5.5% in formal sciences) — even when controlling for an increase in the volume of papers. Our findings raise questions about the scientific community’s engagement with past literature, particularly for NLP, and the potential consequences of neglecting older but relevant research. The data and a demo showcasing our results are publicly available.

BibTeX
@inproceedings{wahle-etal-2025-citation,
    title = "Citation Amnesia: On The Recency Bias of {NLP} and Other Academic Fields",
    author = "Wahle, Jan Philip  and
      Lima Ruas, Terry  and
      Abdalla, Mohamed  and
      Gipp, Bela  and
      Mohammad, Saif M.",
    editor = "Rambow, Owen  and
      Wanner, Leo  and
      Apidianaki, Marianna  and
      Al-Khalifa, Hend  and
      Eugenio, Barbara Di  and
      Schockaert, Steven",
    booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
    month = jan,
    year = "2025",
    address = "Abu Dhabi, UAE",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.coling-main.69/",
    pages = "1027--1044"
}
Citation Amnesia: On The Recency Bias of NLP and Other Academic Fields · COLING 2025