2025
Neural Collapse Inspired Knowledge Distillation
AAAI 2025technical
Existing knowledge distillation (KD) methods have demonstrated their ability to achieve student network performance on par with their teachers. However, the knowledge gap between the teacher and student remains significant and may hinder the effectiveness of the distillation process. In this work, w…