2021
Learning Student-Friendly Teacher Networks for Knowledge Distillation
NeurIPS 2021poster
We propose a novel knowledge distillation approach to facilitate the transfer of dark knowledge from a teacher to a student. Contrary to most of the existing methods that rely on effective training of student models given pretrained teachers, we aim to learn the teacher models that are friendly to s…