← Search

Manyuan Zhang

17 accepted papers

2026

ARES: Multimodal Adaptive Reasoning via Difficulty-Aware Token-Level Entropy Shaping

ICLR 2026poster

Recent advances in multimodal large reasoning models (MLRMs) have substantially improved their ability to solve complex textual and visual tasks. However, these models tend to *overthink* on simple problems, producing unnecessarily lengthy reasoning traces, while *under-exploring* on challenging one…

Cited by 20SourcecodeScholar
2026

AffIn-Space: Learning Affine-Invariant Representations for 3D Spatial Understanding with MLLMs

ICML 2026poster

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in general visual understanding, they suffer from a fundamental geometric fragility: standard visual representations often degrade rapidly under changes in viewpoint and viewing distance. Our analysis identifies that ex…

Cited by 0SourceScholar
2026

AlignVid: Taming Visual Dominance via Training-Free Attention Modulation in Text-guided Image-to-Video Generation

ICML 2026poster

Text-guided image-to-video generation has made substantial progress, yet it still struggles to execute text-specified edits that require substantial changes to a reference image (e.g., object addition, deletion, or modification). Empirically, our analysis reveals that this stems from **visual domina…

Cited by 0SourceScholar
2026

Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence

ICML 2026oral

The pursuit of spatial intelligence fundamentally relies on access to large-scale, fine-grained 3D data. However, existing approaches predominantly construct spatial understanding benchmarks by generating question–answer (QA) pairs from a limited number of manually annotated datasets, rather than sy…

Cited by 0SourceScholar
2026

IGGT: Instance-Grounded Geometry Transformer for Semantic 3D Reconstruction

ICLR 2026poster

Humans naturally perceive the geometric structure and semantic content of a 3D world as intertwined dimensions, enabling coherent and accurate understanding of complex scenes. However, most prior approaches prioritize training large geometry models for low-level 3D reconstruction and treat high-leve…

Cited by 0SourcecodeScholar
2026

OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention

ICML 2026poster

Humans perceive the world through diverse modalities that operate synergistically to support a holistic understanding of their surroundings. However, existing omnimodal models still exhibit substantial performance degradation on visual tasks when the audio modality is incorporated. We identify this …

Cited by 0SourceScholar
2026

OneThinker: All-in-one Reasoning Model for Image and Video

CVPR 2026

Reinforcement learning (RL) has recently achieved remarkable success in eliciting visual reasoning within Multimodal Large Language Models (MLLMs). However, existing approaches typically train separate models for different tasks and treat image and video reasoning as disjoint domains. This results i

Cited by 0SourcecodeScholar
2026

Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views

CVPR 2026

Though recent advances in vision-language models (VLMs) have achieved remarkable progress across a wide range of multimodal tasks, understanding 3D spatial relationships from limited views remains a significant challenge. Previous reasoning methods typically rely on pure text (e.g., topological cogn

Cited by 0SourcecodeScholar
2026

Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation

CVPR 2026

Recent advances in visual generation have increasingly explored the integration of reasoning capabilities. They incorporate textual reasoning, i.e., think, either before (as pre-planning) or after (as post-refinement) the generation process, yet they lack on-the-fly multimodal interaction during the

Cited by 0SourcecodeScholar
2025

LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding

EMNLP 2025

Recent progress in Large Language Models (LLMs) has opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS). However, existing LLM-driven NAS approaches rely heavily on prompt engineering and domain-specific tuning, limiting their practicality and sca

2025

Let's Verify and Reinforce Image Generation Step by Step

CVPR 2025poster

Chain-of-Thought (CoT) reasoning has been extensively explored in large models to tackle complex understanding tasks. However, it still remains an open question whether such strategies can be applied to verifying and reinforcing image generation scenarios. In this paper, we provide the first compreh…

2023

Decoupled DETR: Spatially Disentangling Localization and Classification for Improved End-to-End Object Detection

ICCV 2023poster

The introduction of DETR represents a new paradigm for object detection. However, its decoder conducts classification and box localization using shared queries and cross-attention layers, leading to suboptimal results. We observe that different regions of interest in the visual feature map are sui…

Cited by 23PDFScholar
2023

FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation

CVPR 2023poster

FlowFormer introduces a transformer architecture into optical flow estimation and achieves state-of-the-art performance. The core component of FlowFormer is the transformer-based cost-volume encoder. Inspired by recent success of masked autoencoding (MAE) pretraining in unleashing transformers' capa…

2023

VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation

ICCV 2023poster

We introduce VideoFlow, a novel optical flow estimation framework for videos. In contrast to previous methods that learn to estimate optical flow from two frames, VideoFlow concurrently estimates bi-directional optical flows for multiple frames that are available in videos by sufficiently exploiting…

Cited by 104PDFcodeScholar
2021

Switchable K-Class Hyperplanes for Noise-Robust Representation Learning

ICCV 2021poster

Optimizing the K-class hyperplanes in the latent space has become the standard paradigm for efficient representation learning. However, it's almost impossible to find an optimal K-class hyperplane to accurately describe the latent space of massive noisy data. For this potential problem, we construct…

Cited by 7PDFcodeScholar