← Search

Mohammad Arvan

2 accepted papers

2023

Exploring Variation of Results from Different Experimental Conditions

ACL 2023findings

It might reasonably be expected that running multiple experiments for the same task using the same data and model would yield very similar results. Recent research has, however, shown this not to be the case for many NLP experiments. In this paper, we report extensive coordinated work by two NLP gro…

2022

Reproducibility in Computational Linguistics: Is Source Code Enough?

EMNLP 2022main

The availability of source code has been put forward as one of the most critical factors for improving the reproducibility of scientific research. This work studies trends in source code availability at major computational linguistics conferences, namely, ACL, EMNLP, LREC, NAACL, and COLING. We obse…