Fengyuan Nie

Precision-Induced Miscalibration: Understanding and Correcting Confidence Distortion in Quantized Neural Networks

Low-precision arithmetic is pervasive in neural network training and deployment, yet its effect on prediction \textit{confidence}, not just accuracy, remains unexamined. We show that the softmax function amplifies logit-space quantization errors in an input-dependent manner: confidence distortion sc…