← Search

Benjamin Börschinger

2 accepted papers

2022

Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation

EMNLP 2022main

The predictions of question answering (QA) systems are typically evaluated against manually annotated finite sets of one or more answers. This leads to a coverage limitation that results in underestimating the true performance of systems, and is typically addressed by extending over exact match (EM)…

2021

Fool Me Twice: Entailment from Wikipedia Gamification

NAACL 2021long

We release FoolMeTwice (FM2 for short), a large dataset of challenging entailment pairs collected through a fun multi-player game. Gamification encourages adversarial examples, drastically lowering the number of examples that can be solved using “shortcuts” compared to other popular entailment datas…