Bao Shi

iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract)

Logit Knowledge Distillation has gained substantial research interest in recent years due to its simplicity and lack of requirement for intermediate feature alignment; however, it suffers from limited interpretability in its decision-making process. To address this, we propose implicit Clustering Di