Lev Proleev

Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering

Prompting and in-context learning (ICL) have become efficient learning paradigms for large language models (LLMs). However, LLMs suffer from prompt brittleness and various bias factors in the prompt, including but not limited to the formatting, the choice verbalizers, and the ICL examples. To addres…