Bufan Gao

Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases

As LLMs are increasingly applied in socially impactful settings, concerns about gender bias have prompted growing efforts both to measure and mitigate such bias. These efforts often rely on evaluation tasks that differ from natural language distributions, as they typically involve carefully construc