2025
CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination
AAAI 2025technical
Contrastive Language-Image Pre-training (CLIP) has achieved excellent performance over a wide range of tasks. However, the effectiveness of CLIP heavily relies on a substantial corpus of pre-training data, resulting in notable consumption of computational resources. Although knowledge distillation h…