← Search

Hongyu Xu

8 accepted papers

2026

Mixture of States: Routing Token-Level Dynamics for Multimodal Generation

CVPR 2026

We introduce MoS (Mixture of States), a novel fusion paradigm for multimodal diffusion models that merges modalities using flexible, state-based interactions. The core of MoS is a learnable, token-wise router that creates denoising timestep- and input-dependent interactions between modalities' hidde

Cited by 0SourcecodeScholar
2026

VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction

CVPR 2026

The rapid advancement of Large Multimodal Models (LMMs) for 2D images and videos has sparked interest in extending these models to 3D scenes, with the goal of human-like visual-spatial intelligence. However, achieving deep spatial understanding comparable to human capabilities remains challenging fo

Cited by 0SourcecodeScholar
2026

VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice

CVPR 2026

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for multimodal large language models on video understanding tasks. However, its necessity and advantages over direct answering remain underexplored. In this paper, we first demonstrate that for RL-trained video models, direct answering

Cited by 0SourceScholar
2025

DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling

NeurIPS 2025poster

Understanding the dynamic physical world, characterized by its evolving 3D structure, real-world motion, and semantic content with textual descriptions, is crucial for human-agent interaction and enables embodied agents to perceive and act within real environments with human‑like capabilities. Howev…

Cited by 0SourceScholar
2025

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

CVPR 2025poster

Recent sparse multi-view scene reconstruction advances like DUSt3R and MASt3R no longer require camera calibration and camera pose estimation. However, they only process a pair of views at a time to infer pixel-aligned pointmaps. When dealing with more than two views, a combinatorial number of error…

Cited by 10SourcePDFScholar
2019

Delving Into Robust Object Detection From Unmanned Aerial Vehicles: A Deep Nuisance Disentanglement Approach

ICCV 2019poster

Object detection from images captured by Unmanned Aerial Vehicles (UAVs) is becoming increasingly useful. Despite the great success of the generic object detection methods trained on ground-to-ground images, a huge performance drop is observed when they are directly applied to images captured by UAV…

Cited by 88PDFcodeScholar
2018

Deep Regionlets for Object Detection

ECCV 2018poster

In this paper, we propose a novel object detection framework named "Deep Regionlets" by establishing a bridge between deep neural networks and conventional detection schema for accurate generic object detection. Motivated by the abilities of regionlets for modeling object deformation and multiple as…

Cited by 87SourcePDFScholar