Peter Rankel

Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning

Questions involving commonsense reasoning about everyday situations often admit many possible or plausible answers. In contrast, multiple-choice question (MCQ) benchmarks for commonsense reasoning require a hard selection of a single correct answer, which, in principle, should represent the most pla…