Mostapha Essoullami

LEGACY: A Lightweight Dynamic Gradient Compression Strategy for Distributed Deep Learning

Distributed learning has achieved remarkable success in training deep neural networks (DNNs) on large datasets, but the communication bottleneck limits its scalability. Various compression techniques have been proposed to alleviate this limitation; however, they either use fixed parameters throughou…