A Secure and Efficient Federated Learning Framework for NLP
Chenghong Wang, Jieren Deng, Xianrui Meng, Yijue Wang, Ji Li, Sheng Lin, Shuo Han, Fei Miao
Abstract
In this work, we consider the problem of designing secure and efficient federated learning (FL) frameworks for NLP. Existing solutions under this literature either consider a trusted aggregator or require heavy-weight cryptographic primitives, which makes the performance significantly degraded. Moreover, many existing secure FL designs work only under the restrictive assumption that none of the clients can be dropped out from the training protocol. To tackle these problems, we propose SEFL, a secure and efficient federated learning framework that (1) eliminates the need for the trusted entities; (2) achieves similar and even better model accuracy compared with existing FL designs; (3) is resilient to client dropouts.
BibTeX
@inproceedings{wang-etal-2021-secure,
title = "A Secure and Efficient Federated Learning Framework for {NLP}",
author = "Wang, Chenghong and
Deng, Jieren and
Meng, Xianrui and
Wang, Yijue and
Li, Ji and
Lin, Sheng and
Han, Shuo and
Miao, Fei and
Rajasekaran, Sanguthevar and
Ding, Caiwen",
editor = "Moens, Marie-Francine and
Huang, Xuanjing and
Specia, Lucia and
Yih, Scott Wen-tau",
booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing",
month = nov,
year = "2021",
address = "Online and Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.emnlp-main.606/",
doi = "10.18653/v1/2021.emnlp-main.606",
pages = "7676--7682"
}