Shikang Yu

Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint

Despite the tremendous progress on data-free knowledge distillation (DFKD) based on synthetic data generation, there are still limitations in diverse and efficient data synthesis. It is naive to expect that a simple combination of generative network-based data synthesis and data augmentation will so…