2025
Federated Learning with Heterogeneous LLMs: Integrating Small Student Client Models with a Large Hungry Model
AAAI 2025technical
In recent years, federated learning (FL) has emerged as a promising technique to enable decentralized training of models without the need for data centralization, addressing privacy concerns and reducing communication over-head. The challenge, however, lies in scaling federated systems to accommodat…