2025
Improving the Calibration of Confidence Scores in Text Generation Using the Output Distribution’s Characteristics
ACL 2025short
Well-calibrated model confidence scores can improve the usefulness of text generation models. For example, users can be prompted to review predictions with low confidence scores, to prevent models from returning bad or potentially dangerous predictions. However, confidence metrics are not always wel…