ZhaoJing Zhou

An Efficient Method for Model Pruning Using Knowledge Distillation with Few Samples

Deep neural network compression methods can produce small-scale networks and utilizes fine-tuning to get back the dropped accuracy. Despite their remarkable performance, the fine-tuning procedure is limited to the requirement of a huge training dataset, which is a time-consuming progress. To address…