← Search

Jana Thompson

2 accepted papers

2022

BBQ: A hand-built bias benchmark for question answering

ACL 2022findings

It is well documented that NLP models learn social biases, but little work has been done on how these biases manifest in model outputs for applied tasks like question answering (QA). We introduce the Bias Benchmark for QA (BBQ), a dataset of question-sets constructed by the authors that highlight at…

2022

QuALITY: Question Answering with Long Input Texts, Yes!

NAACL 2022long

To enable building and testing models on long-document comprehension, we introduce QuALITY, a multiple-choice QA dataset with context passages in English that have an average length of about 5,000 tokens, much longer than typical current models can process. Unlike in prior work with passages, our qu…