Mengde Zhu

FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models

Pre-trained foundation models, particularly large language models, have achieved remarkable success and led to massive fine-tuned variants. These models are commonly fine-tuned locally and then uploaded by users to cloud platforms such as HuggingFace for secure storage. However, the huge model numbe…