Yew-Soon Ong*

Adversarially Robust Distillation by Reducing the Student-Teacher Variance Gap

"Adversarial robustness generally relies on large-scale architectures and datasets, hindering resource-efficient deployment. For scalable solutions, adversarially robust knowledge distillation has emerged as a principle strategy, facilitating the transfer of robustness from a large-scale teacher mod…