2023
Input-Dependent Dynamical Channel Association For Knowledge Distillation
ICASSP 2023accepted
Feature-map based knowledge distillation has exhibited its significance in improving the performance of student model. Existing works mainly focus on the formulation of knowledge, but ignore the number difference of channels due to heterogeneous architectures of teacher-student pair. They generally…