Siyin Huang

Embracing Positional Bias in Multiple-Choice Question Answering via Permutation Equivariant Neural Networks

Several studies have demonstrated that large language models (LLMs) exhibit positional bias when answering multiple-choice questions (MCQs). Previous methods have identified such bias to be detrimental, leading to the development of techniques to mitigate it. However, we observe that certain permuta