← Search

Nikita Ivkin

2 accepted papers

2020

FetchSGD: Communication-Efficient Federated Learning with Sketching

ICML 2020poster

Existing approaches to federated learning suffer from a communication bottleneck as well as convergence issues due to sparse client participation. In this paper we introduce a novel algorithm,called FetchSGD, to overcome these challenges. FetchSGD compresses model updates using a Count Sketch, and t…

Cited by 464SourcePDFScholar
2019

Communication-efficient Distributed SGD with Sketching

NeurIPS 2019poster

Large-scale distributed training of neural networks is often limited by network bandwidth, wherein the communication time overwhelms the local computation time. Motivated by the success of sketching methods in sub-linear/streaming algorithms, we introduce Sketched-SGD, an algorithm for carrying out…