Wenkai Zhong

Improving Knowledge Distillation via Cross-Modal Insights from CLIP

Knowledge distillation enhances student performance by transferring knowledge from teachers. However, existing approaches often suffer from a lack of knowledge diversity. To address this issue, we propose Cross-Modal Insights Knowledge Distillation (CIKD), a novel framework that leverages the cross-…