2020
ReSprop: Reuse Sparsified Backpropagation
CVPR 2020oral
The success of Convolutional Neural Networks (CNNs) in various applications is accompanied by a significant increase in computation and training time. In this work, we focus on accelerating training by observing that about 90% of gradients are reusable during training. Leveraging this observation, w…