Mingyu Zhong

Quantized Can Still Be Calibrated: A Unified Framework to Calibration in Quantized Large Language Models

Although weight quantization helps large language models (LLMs) in resource-constrained environments, its influence on the uncertainty calibration remains unexplored. To bridge this gap, we presents a comprehensive investigation of uncertainty calibration for quantized LLMs in this work. Specificall…