Dongjun Nam

Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity

Knowledge Distillation (KD) aims to train a lightweight student model by transferring knowledge from a large, high-capacity teacher. Recent studies have shown that leveraging diverse teacher perspectives can significantly improve distillation performance; however, achieving such diversity typically…