2024
Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources
NeurIPS 2024poster
Federated Learning (FL) has recently been applied to the parameter-efficient fine-tuning of Large Language Models (LLMs). While promising, it raises significant challenges due to the heterogeneous resources and data distributions of clients.This study introduces FlexLoRA, a simple yet effective agg…