Lvxue Li

Debiasing In-Context Learning by Instructing LLMs How to Follow Demonstrations

In-context learning(ICL) has gained considerable attention due to its data efficiency and task adaptability. Unfortunately, ICL suffers from the demonstration bias, i.e., its performance and robustness are severely affected by the selection and ordering of demonstrations. In this paper, we identify…