Zhangchi Zhu

Rejuvenating Cross-Entropy Loss in Knowledge Distillation for Recommender Systems

This paper analyzes Cross-Entropy (CE) loss in knowledge distillation (KD) for recommender systems. KD for recommender systems targets at distilling rankings, especially among items most likely to be preferred, and can only be computed on a small subset of items. Considering these features, we revea…