NeurIPS 2020poster1314 citations
Ensemble Distillation for Robust Model Fusion in Federated Learning
Tao Lin, Lingjing Kong, Sebastian U Stich, Martin Jaggi
Abstract
Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by averaging the parameters of the server model and the updated parameters from the client side. However, directly averaging model parameters is only possible if all models have the same structure and size, which could be a restrictive constraint in many scenarios.
BibTeX
@inproceedings{NEURIPS2020_18df51b9,
author = {Lin, Tao and Kong, Lingjing and Stich, Sebastian U and Jaggi, Martin},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
pages = {2351--2363},
publisher = {Curran Associates, Inc.},
title = {Ensemble Distillation for Robust Model Fusion in Federated Learning},
url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/18df51b97ccd68128e994804f3eccc87-Paper.pdf},
volume = {33},
year = {2020}
}