Xiaoyi Yu

MSJoE: Jointly Evolving MLLM and Sampler for Efficient Long-Form Video Understanding

Efficiently understanding long-form videos remains a fundamental challenge for Multimodal Large Language Models (MLLMs). In this paper, we present MLLM-Sampler Joint Evolution (MSJoE), a novel framework that jointly evolves the MLLM and a lightweight key-frame sampler for efficient long-form video u