Yali Wang* — accepted AI-conference papers

2024

InternVideo2: Scaling Foundation Models for Multimodal Video Understanding

Yi Wang*, Kunchang Li, Xinhao Li, Jiashuo Yu, Yinan He, Guo Chen +12

ECCV 2024poster

"We introduce , a new family of video foundation models (ViFM) that achieve the state-of-the-art results in video recognition, video-text tasks, and video-centric dialogue. Our core design is a progressive training approach that unifies the masked video modeling, crossmodal contrastive learning, and…

Cited by 213 Source ↗PDF ↗code ↗Scholar ↗

2024

VideoMamba: State Space Model for Efficient Video Understanding

Kunchang Li*, Xinhao Li, Yi Wang*, Yinan He, Yali Wang*, Limin Wang* +1

ECCV 2024poster

"Addressing the dual challenges of local redundancy and global dependencies in video understanding, this work innovatively adapts the Mamba to the video domain. The proposed overcomes the limitations of existing 3D convolution neural networks (CNNs) and video transformers. Its linear-complexity oper…

Cited by 243 Source ↗PDF ↗code ↗Scholar ↗