AIConfPaper
ICML 2019oral306 citations

Zero-Shot Knowledge Distillation in Deep Networks

Gaurav Kumar Nayak, Konda Reddy Mopuri, Vaisakh Shaj, Venkatesh Babu Radhakrishnan, Anirban Chakraborty

Source ↗PDF ↗code ↗Scholar ↗TeX ↗

Abstract

Knowledge distillation deals with the problem of training a smaller model (

BibTeX
@InProceedings{pmlr-v97-nayak19a,
  title = 	 {Zero-Shot Knowledge Distillation in Deep Networks},
  author =       {Nayak, Gaurav Kumar and Mopuri, Konda Reddy and Shaj, Vaisakh and Radhakrishnan, Venkatesh Babu and Chakraborty, Anirban},
  booktitle = 	 {Proceedings of the 36th International Conference on Machine Learning},
  pages = 	 {4743--4751},
  year = 	 {2019},
  editor = 	 {Chaudhuri, Kamalika and Salakhutdinov, Ruslan},
  volume = 	 {97},
  series = 	 {Proceedings of Machine Learning Research},
  month = 	 {09--15 Jun},
  publisher =    {PMLR},
  pdf = 	 {http://proceedings.mlr.press/v97/nayak19a/nayak19a.pdf},
  url = 	 {https://proceedings.mlr.press/v97/nayak19a.html},
  abstract = 	 {Knowledge distillation deals with the problem of training a smaller model (
Zero-Shot Knowledge Distillation in Deep Networks · ICML 2019