2026
iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract)
AAAI 2026technical
Logit Knowledge Distillation has gained substantial research interest in recent years due to its simplicity and lack of requirement for intermediate feature alignment; however, it suffers from limited interpretability in its decision-making process. To address this, we propose implicit Clustering Di