Fadi Boutros*

AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognition

"Knowledge distillation (KD) aims at improving the performance of a compact student model by distilling the knowledge from a high-performing teacher model. In this paper, we present an adaptive KD approach, namely AdaDistill, for deep face recognition. The proposed AdaDistill embeds the KD concept i…