2024
Bayesian Prompt Ensembles: Model Uncertainty Estimation for Black-Box Large Language Models
ACL 2024findings
An important requirement for the reliable deployment of pre-trained large language models (LLMs) is the well-calibrated quantification of the uncertainty in their outputs. While the likelihood of predicting the next token is a practical surrogate of the data uncertainty learned during training, mode…