Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution

Connor Baumler; Rachel Rudinger

NAACL 2022long15 citations

Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution

Abstract

As using they/them as personal pronouns becomes increasingly common in English, it is important that coreference resolution systems work as well for individuals who use personal “they” as they do for those who use gendered personal pronouns. We introduce a new benchmark for coreference resolution systems which evaluates singular personal “they” recognition. Using these WinoNB schemas, we evaluate a number of publicly available coreference resolution systems and confirm their bias toward resolving “they” pronouns as plural.

BibTeX

@inproceedings{baumler-rudinger-2022-recognition,
    title = "Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution",
    author = "Baumler, Connor  and
      Rudinger, Rachel",
    editor = "Carpuat, Marine  and
      de Marneffe, Marie-Catherine  and
      Meza Ruiz, Ivan Vladimir",
    booktitle = "Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies",
    month = jul,
    year = "2022",
    address = "Seattle, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.naacl-main.250/",
    doi = "10.18653/v1/2022.naacl-main.250",
    pages = "3426--3432"
}