Wantao Liu

Accelerating Distributed Deep Learning By Adaptive Gradient Quantization

To accelerate distributed deep learning, gradient quantization technique is widely used to reduce the communication cost. However, the existing quantization schemes suffer from either model accuracy degradation or low compression ratio (arisen from a redundant setting of quantization level or high o…