← Search

Zizheng Huang

7 accepted papers

2026

Balancing the Experts: Unlocking LoRA-MoE for GRPO via Mechanism-Aware Rewards

ICLR 2026poster

Parameter-efficient Mixture-of-Experts (MoE) architectures, such as LoRA-MoE, enable strong and generalizable fine-tuning. However, a critical problem arises when fine-tuning these architectures with advanced reinforcement learning algorithms such as Group Relative Policy Optimization (GRPO). Tradit…

Cited by 0SourceScholar
2026

VideoSeeker: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning

ICML 2026poster

Existing multimodal large language models for long-video understanding predominantly rely on uniform sampling and single-turn inference, limiting their ability to identify sparse yet critical evidence amid extensive redundancy. We introduce VideoSeeker, a novel framework that supports iterative disc…

Cited by 13SourceScholar
2025

Efficient Transfer Learning for Video-language Foundation Models

CVPR 2025poster

Pre-trained vision-language models provide a robust foundation for efficient transfer learning across various downstream tasks. In the field of video action recognition, mainstream approaches often introduce additional modules to capture temporal information. Although the additional modules increase…

2025

Stochastic Layer-Wise Shuffle for Improving Vision Mamba Training

ICML 2025poster

Recent Vision Mamba (Vim) models exhibit nearly linear complexity in sequence length, making them highly attractive for processing visual data. However, the training methodologies and their potential are still not sufficiently explored. In this paper, we investigate strategies for Vim and propose St…

2025

VRBench: A Benchmark for Multi-Step Reasoning in Long Narrative Videos

ICCV 2025poster

We present VRBench, the first long narrative video benchmark crafted for evaluating large models' multi-step reasoning capabilities, addressing limitations in existing evaluations that overlook temporal reasoning and procedural validity. It comprises 960 long videos (with an average duration of 1.6…

Cited by 0SourcePDFScholar
2023

Enhanced Tensor Low-Rank and Sparse Representation Recovery for Incomplete Multi-View Clustering

AAAI 2023technical

Incomplete multi-view clustering (IMVC) has attracted remarkable attention due to the emergence of multi-view data with missing views in real applications. Recent methods attempt to recover the missing information to address the IMVC problem. However, they generally cannot fully explore the underlyi…

Cited by 71SourcePDFScholar
2023

Model-Aware Contrastive Learning: Towards Escaping the Dilemmas

ICML 2023poster

Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as uniformity-tolerance dilemma (UTD) and gradient reduction, both of which are related to a $\mathcal{P}_{ij}$ term. It h…