2023
ORC: Network Group-based Knowledge Distillation using Online Role Change
ICCV 2023poster
In knowledge distillation, since a single, omnipotent teacher network cannot solve all problems, multiple teacher-based knowledge distillations have been studied recently. However, sometimes their improvements are not as good as expected because some immature teachers may transfer the false knowledg…