Is Peer-Reviewing Worth the Effort?

Kenneth Ward Church; Raman Chandrasekar; John E. Ortega; Ibrahim Said Ahmad

COLING 2025main1 citations

Is Peer-Reviewing Worth the Effort?

Kenneth Ward Church, Raman Chandrasekar, John E. Ortega, Ibrahim Said Ahmad

Abstract

How effective is peer-reviewing in identifying important papers? We treat this question as a forecasting task. Can we predict which papers will be highly cited in the future based on venue and “early returns” (citations soon after publication)? We show early returns are more predictive than venue. Finally, we end with a constructive suggestion to simplify reviewing.

BibTeX

@inproceedings{church-etal-2025-peer,
    title = "Is Peer-Reviewing Worth the Effort?",
    author = "Church, Kenneth Ward  and
      Chandrasekar, Raman  and
      Ortega, John E.  and
      Ahmad, Ibrahim Said",
    editor = "Rambow, Owen  and
      Wanner, Leo  and
      Apidianaki, Marianna  and
      Al-Khalifa, Hend  and
      Eugenio, Barbara Di  and
      Schockaert, Steven",
    booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
    month = jan,
    year = "2025",
    address = "Abu Dhabi, UAE",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.coling-main.242/",
    pages = "3589--3599"
}