Andrew McNutt

Explaining Why: How Instructions and User Interfaces Impact Annotator Rationales When Labeling Text Data

In the context of data labeling, NLP researchers are increasingly interested in having humans select rationales, a subset of input tokens relevant to the chosen label. We conducted a 332-participant online user study to understand how humans select rationales, especially how different instructions a…