Sitiporn Sae Lim

Identifying and Mitigating Annotation Bias in Natural Language Understanding using Causal Mediation Analysis

NLU models have achieved promising results on standard benchmarks. Despite state-of-the-art accuracy, analysis reveals that many models make predictions using annotation bias rather than the properties we intend the model to learn. Consequently, these models perform poorly on out-of-distribution dat…