Tommaso Pegolotti

SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks at the Edge

We provide an efficient implementation of the backpropagation algorithm, specialized to the case where the weights of the neural network being trained are _sparse_. Our algorithm is general, as it applies to arbitrary (unstructured) sparsity and common layer types (e.g., convolutional or linear). We…