3 accepted papers
Large Vision Language Models (LVLMs) have achieved remarkable success in a wide range of downstream tasks that require multimodal interaction, but their powerful capabilities come with substantial computational and memory overhead, which hinders practical deployment. Among numerous acceleration tech
Instruction tuning is widely used to enhance a pre-trained Multimodal Large Language Model (MLLM) to understand and follow human instructions by training it on a curated set of task-specific dataset. However, it is infeasible to collect all possible instruction datasets simultaneously in real-world…
Multi-task model fusion (MTMF) aims to integrate the capabilities of individual models into a unified model. Past approaches either require extensive training and fine-tuning or necessitate that models share the same pre-training and initialization. Recently, several fusion methods have been propose…