2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning
CVPR 2023poster
Self-supervised learning (SSL) has made remarkable progress in visual representation learning. Some studies combine SSL with knowledge distillation (SSL-KD) to boost the representation learning performance of small models. In this study, we propose a Multi-mode Online Knowledge Distillation method (…