← Search

Gongjie Zhang

13 accepted papers

2026

GP3: A 3D Geometry-Aware Policy with Multi-View Images for Robotic Manipulation

ICRA 2026poster

Effective robotic manipulation relies on a precise understanding of 3D scene geometry, and one of the most straightforward ways to acquire such geometry is through multi-view observations. Motivated by this, we present GP3—a 3D geometry-aware robotic manipulation policy that leverages multi-view inp…

2026

On the Generalization Capacities of MLLMs for Spatial Intelligence

ICLR 2026oral

Multimodal Large Language Models (MLLMs) that directly process RGB inputs for tasks like 3D localization and navigation have shown remarkable potential. However, we argue that these ``RGB-only'' approaches are fundamentally flawed in their ability to generalize across cameras. By ignoring camera par…

Cited by 0SourcecodeScholar
2025

Towards Scalable Spatial Intelligence via 2D-to-3D Data Lifting

ICCV 2025poster

Spatial intelligence is emerging as a transformative frontier in AI, yet it remains constrained by the scarcity of large-scale 3D datasets. Unlike the abundant 2D imagery, acquiring 3D data typically requires specialized sensors and laborious annotation. In this work, we present a scalable pipeline…

2024

Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Mining

CVPR 2024poster

Cross-Domain Few-Shot Segmentation (CD-FSS) poses the challenge of segmenting novel categories from a distinct domain using only limited exemplars. In this paper we undertake a comprehensive study of CD-FSS and uncover two crucial insights: (i) the necessity of a fine-tuning stage to effectively tra…

2024

Modeling Continuous Motion for 3D Point Cloud Object Tracking

AAAI 2024technical

The task of 3D single object tracking (SOT) with LiDAR point clouds is crucial for various applications, such as autonomous driving and robotics. However, existing approaches have primarily relied on appearance matching or motion modeling within only two successive frames, thereby overlooking the lo…

Cited by 6SourcePDFScholar
2023

DA-DETR: Domain Adaptive Detection Transformer With Information Fusion

CVPR 2023poster

The recent detection transformer (DETR) simplifies the object detection pipeline by removing hand-crafted designs and hyperparameters as employed in conventional two-stage object detectors. However, how to leverage the simple yet effective DETR architecture in domain adaptive object detection is lar…

Cited by 81SourcePDFScholar
2023

Online Map Vectorization for Autonomous Driving: A Rasterization Perspective

NeurIPS 2023poster

High-definition (HD) vectorized map is essential for autonomous driving, providing detailed and precise environmental information for advanced perception and planning. However, current map vectorization methods often exhibit deviations, and the existing evaluation metric for map vectorization lacks…

2023

Towards Efficient Use of Multi-Scale Features in Transformer-Based Object Detectors

CVPR 2023poster

Multi-scale features have been proven highly effective for object detection but often come with huge and even prohibitive extra computation costs, especially for the recent Transformer-based detectors. In this paper, we propose Iterative Multi-scale Feature Aggregation (IMFA) - a generic paradigm th…

2022

Accelerating DETR Convergence via Semantic-Aligned Matching

CVPR 2022poster

The recently developed DEtection TRansformer (DETR) establishes a new object detection paradigm by eliminating a series of hand-crafted components. However, DETR suffers from extremely slow convergence, which increases the training cost significantly. We observe that the slow convergence is largely…

Cited by 129PDFcodeScholar
2022

GenCo: Generative Co-training for Generative Adversarial Networks with Limited Data

AAAI 2022technical

Training effective Generative Adversarial Networks (GANs) requires large amounts of training data, without which the trained models are usually sub-optimal with discriminator over-fitting. Several prior studies address this issue by expanding the distribution of the limited training data via massive…

Cited by 39SourcePDFScholar
2021

Unbalanced Feature Transport for Exemplar-Based Image Translation

CVPR 2021poster

Despite the great success of GANs in images translation with different conditioned inputs such as semantic segmentation and edge map, generating high-fidelity images with reference styles from exemplars remains a grand challenge in conditional image-to-image translation. This paper presents a genera…

Cited by 235PDFScholar
2021

Unsupervised Domain Adaptive 3D Detection With Multi-Level Consistency

ICCV 2021poster

Deep learning-based 3D object detection has achieved unprecedented success with the advent of large-scale autonomous driving datasets. However, drastic performance degradation remains a critical challenge for cross-domain deployment. In addition, existing 3D domain adaptive detection methods often a…

Cited by 98PDFScholar