SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
Federated fine-tuning is critical for improving the performance of large language models (LLMs) in handling domain-specific tasks while keeping training data decentralized and private. However, prior work has shown that clients' private data can actually be recovered via gradient inversion attacks.…