Haigang Gong

AMLN: Adversarial-based Mutual Learning Network for Online Knowledge Distillation

Online knowledge distillation has attracted increasing interest recently, which jointly learns teacher and student models or an ensemble of student models simultaneously and collaboratively. On the other hand, existing works focus more on outcome-driven learning according to knowledge like classific…