Xin'ao Wang

FedBFPT: An Efficient Federated Learning Framework for Bert Further Pre-training

This study proposes FEDBFPT (Federated BERT Further Pre-Training), a Federated Learning (FL) framework for further pre-training the BERT language model in specialized domains while addressing privacy concerns. FEDBFPT enables multiple clients to collaboratively train the shallower layers of BERT, wh…