Hsing-Huan Chung

Guiding Mixture-of-Experts with Temporal Multimodal Interactions

Mixture-of-Experts (MoE) architectures have become pivotal for large-scale multimodal models. However, their routing mechanisms typically overlook the informative, time-varying interaction dynamics between modalities. This limitation hinders expert specialization, as the model cannot explicitly leve…