Yuansheng Zhu Zhu.

Mixing Expertise with Confidence: A Mixture of Expert Framework for Robust Multi-Modal Continual Learner

The Mixture of Experts (MoE) framework is widely used in continual learning to mitigate catastrophic forgetting. MoEs typically combine a small inter-task shared parameter space with largely independent expert parameters. However, as the number of tasks increases, the shared space becomes a bottlene…