← Search

Maitrey Mehta

2 accepted papers

2023

Verifying Annotation Agreement without Multiple Experts: A Case Study with Gujarati SNACS

ACL 2023findings

Good datasets are a foundation of NLP research, and form the basis for training and evaluating models of language use. While creating datasets, the standard practice is to verify the annotation consistency using a committee of human annotators. This norm assumes that multiple annotators are availabl…