Martin Kersner

Temporal Knowledge Distillation for on-device Audio Classification

Improving the performance of on-device audio classification models remains a challenge given the computational limits of the mobile environment. Many studies leverage knowledge distillation to boost predictive performance by transferring the knowledge from large models to on-device models. However,…