2023
Rethinking Data Distillation: Do Not Overlook Calibration
ICCV 2023poster
Neural networks trained on distilled data often produce over-confident output and require correction by calibration methods. Existing calibration methods such as temperature scaling and mixup work well for networks trained on original large-scale data. However, we find that these methods fail to cal…