Alexandros Ntoulas

DeepReduce: A Sparse-tensor Communication Framework for Federated Deep Learning

Sparse tensors appear frequently in federated deep learning, either as a direct artifact of the deep neural network’s gradients, or as a result of an explicit sparsification process. Existing communication primitives are agnostic to the peculiarities of deep learning; consequently, they impose unne…