← Search

Yongkai Chen

2 accepted papers

2024

Bayesian Knowledge Distillation: A Bayesian Perspective of Distillation with Uncertainty Quantification

ICML 2024poster

Knowledge distillation (KD) has been widely used for model compression and deployment acceleration. Nonetheless, the statistical insight of the remarkable performance of KD remains elusive, and methods for evaluating the uncertainty of the distilled model/student model are lacking. To address these…

Cited by 3SourcePDFScholar