Xiukang Yang

Reinforcement Learning-Based Multi-Teacher Knowledge Distillation for Enhancing Retrieval Ranking Consistency

Knowledge Distillation, an effective model compression technique, transfers knowledge from a large teacher model to a smaller student model, reducing computational costs while maintaining model performance. In large-scale retrieval tasks, maintaining the consistency of retrieval result rankings is c…