Zhaoxi Ke

Routing Experts: Learning to Route Dynamic Experts in Existing Multi-modal Large Language Models

Recently, mixture of experts (MoE) has become a popular paradigm for achieving the trade-off between modal capacity and efficiency of multimodal large language models (MLLMs). Different from previous efforts, we are dedicated to exploring the dynamic experts in existing MLLMs and showing that a stan…