Wang Zihan

MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning

The growing demand for larger-scale models in the development of Large Language Models (LLMs) poses challenges for efficient training within limited computational resources. Traditional fine-tuning methods often exhibit instability in multi-task learning and rely heavily on extensive training resour…