Nusrat Prottasha

LiME: Lightweight Mixture of Experts for Efficient Multimodal Multi-task Learning

MoE-PEFT methods combine Mixture of Experts with parameter-efficient fine-tuning for multi-task adaptation, but require separate adapters per expert—causing trainable parameters to scale linearly with expert count and limiting applicability to adapter-based architectures. We propose LiME (Lightweigh…