← Search

Gal Mendelson

2 accepted papers

2022

EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learning

ICML 2022spotlight

Distributed Mean Estimation (DME) is a central building block in federated learning, where clients send local gradients to a parameter server for averaging and updating the model. Due to communication constraints, clients often use lossy compression techniques to compress the gradients, resulting in…

2021

DRIVE: One-bit Distributed Mean Estimation

NeurIPS 2021poster

We consider the problem where $n$ clients transmit $d$-dimensional real-valued vectors using $d(1+o(1))$ bits each, in a manner that allows the receiver to approximately reconstruct their mean. Such compression problems naturally arise in distributed and federated learning. We provide novel mathemat…