2024
A New Similarity-Based Relational Knowledge Distillation Method
ICASSP 2024accepted
The previous relation-based knowledge distillation methods tend to construct global similarity relationship matrix in a mini-batch while ignoring the knowledge of neighbourhood relationship. In this paper, we propose a new similarity-based relational knowledge distillation method that transfers neig…