Class-wise Adaptive Logits Distillation with Meta-Learning
Knowledge distillation has become a crucial technique for transferring intricate knowledge from a teacher model to a smaller student model. While logit-based knowledge distillation has shown promise, existing methods often overlook the efficient distillation of logits. In this paper, we introduce a…