2023
IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation
IJCAI 2023poster
Knowledge distillation (KD) is an effective method for transferring the knowledge of a teacher model to a student model, that aims to improve the latter's performance efficiently. Although generic knowledge distillation methods such as softmax representation distillation and intermediate feature mat…