← Search

Nicholas Cain

2 accepted papers

2022

Mitigating Bias in Calibration Error Estimation

AISTATS 2022poster

For an AI system to be reliable, the confidence it expresses in its decisions must match its accuracy. To assess the degree of match, examples are typically binned by confidence and the per-bin mean confidence and accuracy are compared. Most research in calibration focuses on techniques to reduce th…

2021

Soft Calibration Objectives for Neural Networks

NeurIPS 2021poster

Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under- or over-confident in their predictions. Consequently, methods have been developed to improve the calibration of their predictive un…

Cited by 97SourcePDFScholar