Liangqi Zhong

Self Knowledge Distillation Based On Layer-Wise Weighted Feature Imitation For Efficient Object Detection

Knowledge Distillation (KD)[1] is a widely-used technology to inherit information from cumbersome teacher models to compact student models, consequently realizing model compression and acceleration. Compared with image classification, object detection is a more complex task, and designing specific K…