← Search

Jian Pu

36 accepted papers

2026

ARTDECO: Toward High-Fidelity On-the-Fly Reconstruction with Hierarchical Gaussian Structure and Feed-Forward Guidance

ICLR 2026poster

On-the-fly 3D reconstruction from monocular image sequences is a long-standing challenge in computer vision, critical for applications such as real-to-sim, AR/VR, and robotics. Existing methods face a major tradeoff: per-scene optimization yields high fidelity but is computationally expensive, where…

Cited by 0SourcecodeScholar
2026

CausalVAD: De-confounding End-to-End Autonomous Driving via Causal Intervention

CVPR 2026

Planning-oriented end-to-end driving models show great promise, yet they fundamentally learn statistical correlations instead of true causal relationships. This vulnerability leads to causal confusion, where models exploit dataset biases as shortcuts, critically harming their reliability and safety

Cited by 0SourceScholar
2026

Decoupling Scene Perception and Ego Status: A Multi-Context Fusion Approach for Enhanced Generalization in End-to-End Autonomous Driving

AAAI 2026technical

Modular design of planning-oriented autonomous driving has markedly advanced end-to-end systems. However, existing architectures remain constrained by an over-reliance on ego status, hindering generalization and robust scene understanding. We identify the root cause as an inherent design within thes

Cited by 0SourcePDFScholar
2026

DynamicVGGT: Learning Dynamic Point Maps for 4D Scene Reconstruction in Autonomous Driving

CVPR 2026

Dynamic scene reconstruction in autonomous driving remains a fundamental challenge due to significant temporal variations, moving objects, and complex scene dynamics. Existing feed-forward 3D models have demonstrated strong performance in static reconstruction but still struggle to capture dynamic m

Cited by 0SourceScholar
2026

GIFT: Global Irreplaceability Frame Targeting for Efficient Video Understanding

CVPR 2026

Video Large Language Models (VLMs) have achieved remarkable success in video understanding, but the significant computational cost from processing dense frames severely limits their practical application. Existing methods alleviate this by selecting keyframes, but their greedy decision-making, combi

Cited by 0SourceScholar
2026

Learning Global Representation from Queries for Vectorized HD Map Construction

ICML 2026poster

The online construction of vectorized high-definition (HD) maps is a cornerstone of modern autonomous driving systems. State-of-the-art approaches, particularly those based on the DETR framework, formulate this as an instance detection problem. However, their reliance on independent, learnable objec…

Cited by 0SourceScholar
2026

MacTok: Robust Continuous Tokenization for Image Generation

CVPR 2026

Continuous image tokenizers enable efficient visual generation, and those based on variational frameworks can learn smooth, structured latent representations through KL regularization. Yet this often leads to posterior collapse when using fewer tokens, where the encoder fails to encode informative f

Cited by 0SourceScholar
2026

PAPL-SLAM: Principal Axis-Anchored Monocular Point-Line SLAM

ICRA 2026poster

In point-line Simultaneous Localization and Mapping (SLAM) systems, the utilization of line structural information and the optimization of lines are two significant problems. The former is usually addressed through structural regularities, while the latter typically involves using minimal parameter …

2026

Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models

ICML 2026poster

While Diffusion Large Language Models (dLLMs) offer structural advantages for global planning, efficiently verifying that they arrive at correct answers via valid reasoning traces remains a critical challenge. In this work, we propose a geometric perspective: Reasoning on the Manifold. We hypothesiz…

Cited by 0SourceScholar
2025

A2DO: Adaptive Anti-Degradation Odometry with Deep Multi-Sensor Fusion for Autonomous Navigation

ICRA 2025

Accurate localization is essential for the safe and effective navigation of autonomous vehicles, and Simultaneous Localization and Mapping (SLAM) is a cornerstone technology in this context. However, The performance of the SLAM system can deteriorate under challenging conditions such as low light, a

Cited by 1SourceScholar
2025

Certificating Safety of Imitation Learning for Autonomous Driving With Learnable Weighted Control Barrier Functions

RA-L 2025

Imitation learning is increasingly utilized to improve driving performance using real-world data, yet ensuring the safety of its outputs remains a fundamental challenge. While differentiable optimization-based methods are widely employed to enhance safety of imitation planner, their joint training o

Cited by 0SourceScholar
2025

Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection

ICCV 2025poster

Low-light Object detection is crucial for many real-world applications but remains challenging due to degraded image quality. While recent studies have shown that RAW images offer superior potential over RGB images, existing approaches either use RAW-RGB images with information loss or employ comple…

Cited by 0SourcePDFScholar
2025

Learning Spatial-Aware Manipulation Ordering

NeurIPS 2025poster

Manipulation in cluttered environments is challenging due to spatial dependencies among objects, where an improper manipulation order can cause collisions or blocked access. Existing approaches often overlook these spatial relationships, limiting their flexibility and scalability. To address these l…

Cited by 0SourceScholar
2025

PC-BEV: An Efficient Polar-Cartesian BEV Fusion Framework for LiDAR Semantic Segmentation

AAAI 2025technical

Although multiview fusion has demonstrated potential in LiDAR segmentation, its dependence on computationally intensive point-based interactions, arising from the lack of fixed correspondences between views such as range view and Bird's-Eye View (BEV), hinders its practical deployment. This paper ch…

2024

Automated Label Unification for Multi-Dataset Semantic Segmentation with GNNs

NeurIPS 2024poster

Deep supervised models possess significant capability to assimilate extensive training data, thereby presenting an opportunity to enhance model performance through training on multiple datasets. However, conflicts arising from different label spaces among datasets may adversely affect model performa…

2024

FD3D: Exploiting Foreground Depth Map for Feature-Supervised Monocular 3D Object Detection

AAAI 2024technical

Monocular 3D object detection usually adopts direct or hierarchical label supervision. Recently, the distillation supervision transfers the spatial knowledge from LiDAR- or stereo-based teacher networks to monocular detectors, but remaining the domain gap. To mitigate this issue and pursue adequate…

Cited by 6SourcePDFScholar
2024

FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird’s-Eye View and Perspective View

ICRA 2024poster

In autonomous driving, 3D occupancy prediction outputs voxel-wise status and semantic labels for more comprehensive understandings of 3D scenes compared with traditional perception tasks, such as 3D object detection and bird’s-eye view (BEV) semantic segmentation. Recent researchers have extensively…

Cited by 35SourceScholar
2024

HP3: Hierarchical Prediction-Pretrained Planning for Unprotected Left Turn

IROS 2024poster

Trajectory planning for unprotected left turns poses a significant challenge in autonomous driving. Reinforcement learning (RL) offers potential, but existing methods often rely on scenario-specific state representations, limiting their adaptability. This paper introduces Hierarchical Prediction-Pre…

Cited by 0SourceScholar
2024

Mitigating Causal Confusion in Vector-Based Behavior Cloning for Safer Autonomous Planning

ICRA 2024poster

The utilization of vector-based deep learning techniques has great prospects in the realm of autonomous driving, particularly in the domains of prediction and planning tasks. However, the application of vector-based backbones for prediction and planning tasks may lead to the occurrence of causal con…

Cited by 1SourceScholar
2024

PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completion

ICRA 2024poster

Semantic Scene Completion (SSC) aims to jointly generate space occupancies and semantic labels for complex 3D scenes. Most existing SSC models focus on volumetric representations, which are memory-inefficient for large outdoor spaces. Point clouds provide a lightweight alternative but existing bench…

Cited by 5SourcecodeScholar
2023

ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation

CoRL 2023poster

Monocular depth estimation is challenging due to its inherent ambiguity and ill-posed nature, yet it is quite important to many applications. While recent works achieve limited accuracy by designing increasingly complicated networks to extract features with limited spatial geometric cues from a sing…

Cited by 2SourceScholar
2023

Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection

AAAI 2023technical

Monocular 3D object detection is a low-cost but challenging task, as it requires generating accurate 3D localization solely from a single image input. Recent developed depth-assisted methods show promising results by using explicit depth maps as intermediate features, which are either precomputed by…

2023

From Node Interaction To Hop Interaction: New Effective and Scalable Graph Learning Paradigm

CVPR 2023poster

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following limitation. First, the scalability limitation precludes the br…

2023

Learning Monocular Depth in Dynamic Environment via Context-aware Temporal Attention

IJCAI 2023poster

The monocular depth estimation task has recently revealed encouraging prospects, especially for the autonomous driving task. To tackle the ill-posed problem of 3D geometric reasoning from 2D monocular images, multi-frame monocular methods are developed to leverage the perspective correlation informa…

Cited by 0SourcePDFScholar
2023

MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusion

ICRA 2023poster

Multi-view radar-camera fused 3D object detection provides a farther detection range and more helpful features for autonomous driving, especially under adverse weather. The current radar-camera fusion methods deliver kinds of designs to fuse radar information with camera data. However, these fusion…

Cited by 46SourceScholar
2023

MonoPGC: Monocular 3D Object Detection with Pixel Geometry Contexts

ICRA 2023poster

Monocular 3D object detection reveals an economical but challenging task in autonomous driving. Recently center-based monocular methods have developed rapidly with a great trade-off between speed and accuracy, where they usually depend on the object center's depth estimation via 2D features. However…

Cited by 29SourceScholar
2023

Multi-to-Single Knowledge Distillation for Point Cloud Semantic Segmentation

ICRA 2023poster

3D point cloud semantic segmentation is one of the fundamental tasks for environmental understanding. Although significant progress has been made in recent years, the performance of classes with few examples or few points is still far from satisfactory. In this paper, we propose a novel multi-to-sin…

Cited by 6SourcecodeScholar
2022

Memory-Based Message Passing: Decoupling the Message for Propagation from Discrimination

ICASSP 2022accepted

Message passing is a fundamental procedure for graph neural networks in the field of graph representation learning. Based on the homophily assumption, the current message passing always aggregates features of connected nodes, such as the graph Laplacian smoothing process. However, real-world graphs…

Cited by 0SourceScholar
2021

Selfgait: A Spatiotemporal Representation Learning Method for Self-Supervised Gait Recognition

ICASSP 2021accepted

Gait recognition plays a vital role in human identification since gait is a unique biometric feature that can be perceived at a distance. Although existing gait recognition methods can learn gait features from gait sequences in different ways, the performance of gait recognition suffers from insuffi…

Cited by 0SourceScholar