2021
Progressive Network Grafting for Few-Shot Knowledge Distillation
AAAI 2021technical
Knowledge distillation has demonstrated encouraging performances in deep model compression. Most existing approaches, however, require massive labeled data to accomplish the knowledge transfer, making the model compression a cumbersome and costly process. In this paper, we investigate the practical…