Yanzhuo Xiang

Cross-Layer Graph Knowledge Distillation for Image Recognition

Knowledge Distillation (KD) aims to improve a light-weight student network supervised by a large teacher network. The core idea of KD is to explore valuable knowledge from the teacher. Previous works often extract information from a single sample, but ignore relation modeling among multiple samples…