Cédric M John

Competitive Distillation: A Simple Learning Strategy for Improving Visual Classification

Deep Neural Networks (DNNs) have significantly advanced the field of computer vision. To improve DNN training process, knowledge distillation methods demonstrate their effectiveness in accelerating network training by introducing a fixed learning direction from the teacher network to student network…