← Search

Junqiao Zhao

27 accepted papers

2026

Beyond Penalization: Diffusion-based Out-of-Distribution Detection and Selective Regularization in Offline Reinforcement Learning

ICLR 2026poster

Offline reinforcement learning (RL) faces a critical challenge of overestimating the value of out-of-distribution (OOD) actions. Existing methods mitigate this issue by penalizing unseen samples, yet they fail to accurately identify OOD actions and may suppress beneficial exploration beyond the beh…

Cited by 0SourceScholar
2026

MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene

CVPR 2026

Generalizable Neural Radiance Fields (GeNeRF) enable high-quality scene reconstruction from a limited number of views and can generalize to unseen scenes. However, in real-world environments, transient distractors disrupt structural consistency across views, leading to deviated supervision signals a

Cited by 0SourcecodeScholar
2026

Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics

ICML 2026poster

Agentic systems have recently become the dominant paradigm for formal theorem proving, achieving strong performance by coordinating multiple models and tools. However, existing approaches often rely on task-specific pipelines and trained formal provers, limiting their flexibility and reproducibility…

Cited by 0SourceScholar
2026

Potentially Optimal Joint Actions Recognition for Cooperative Multi-Agent Reinforcement Learning

ICLR 2026poster

Value function factorization is widely used in cooperative multi-agent reinforcement learning (MARL). Existing approaches often impose monotonicity constraints between the joint action value and individual action values to enable decentralized execution. However, such constraints limit the expressiv…

Cited by 0SourceScholar
2026

Signal Structure-Aware Gaussian Splatting for Large-Scale Scene Reconstruction

ICLR 2026poster

3D Gaussian Splatting has demonstrated remarkable potential in novel view synthesis. In contrast to small-scale scenes, large-scale scenes inevitably contain sparsely observed regions with excessively sparse initial points. In this case, supervising Gaussians initialized from low-frequency sparse po…

Cited by 0SourceScholar
2025

Batch Informed Vines (BIV*): Heuristically Guided Exploration of Narrow Passages by Batch Vine Expansion

RA-L 2025

Commonly used asymptotically convergent sampling algorithms (SBP) often utilize the Informed Set (IS) to enhance sampling efficiency. However, IS typically requires obtaining a low-cost solution first, which is challenging when narrow passages are present in the environment. To address the narrow pa

Cited by 4SourceScholar
2025

CERTAIN: Context Uncertainty-aware One-Shot Adaptation for Context-based Offline Meta Reinforcement Learning

ICML 2025poster

Existing context-based offline meta-reinforcement learning (COMRL) methods primarily focus on task representation learning and given-context adaptation performance. They often assume that the adaptation context is collected using task-specific behavior policies or through multiple rounds of collecti…

Cited by 0SourcePDFScholar
2025

CHPO: Constrained Hybrid-action Policy Optimization for Reinforcement Learning

NeurIPS 2025poster

Constrained hybrid-action reinforcement learning (RL) promises to learn a safe policy within a parameterized action space, which is particularly valuable for safety-critical applications involving discrete-continuous hybrid action spaces. However, existing hybrid-action RL algorithms primarily focus…

Cited by 0SourceScholar
2025

Convex Hull-based Algebraic Constraint for Visual Quadric SLAM

IROS 2025

Using Quadrics as the object representation has the benefits of both generality and closed-form projection derivation between image and world spaces. Although numerous constraints have been proposed for dual quadric reconstruction, we found that many of them are imprecise and provide minimal improve

Cited by 0SourcecodeScholar
2025

KineDex: Learning Tactile-Informed Visuomotor Policies via Kinesthetic Teaching for Dexterous Manipulation

CoRL 2025poster

Collecting demonstrations enriched with fine-grained tactile information is critical for dexterous manipulation, particularly in contact-rich tasks that require precise force control and physical interaction. While prior works primarily focus on teleoperation or video-based retargeting, they often s…

Cited by 0SourceScholar
2025

MutualVPR: A Mutual Learning Framework for Resolving Supervision Inconsistencies via Adaptive Clustering

NeurIPS 2025poster

Visual Place Recognition (VPR) enables robust localization through image retrieval based on learned descriptors. However, drastic appearance variations of images at the same place caused by viewpoint changes can lead to inconsistent supervision signals, thereby degrading descriptor learning. Exi…

Cited by 0SourceScholar
2025

Scrutinize What We Ignore: Reining In Task Representation Shift Of Context-Based Offline Meta Reinforcement Learning

ICLR 2025poster

Offline meta reinforcement learning (OMRL) has emerged as a promising approach for interaction avoidance and strong generalization performance by leveraging pre-collected data and meta-learning techniques. Previous context-based approaches predominantly rely on the intuition that alternating optimi…

2025

UN3-Mapping: Uncertainty-Aware Neural Non-Projective Signed Distance Fields for 3D Mapping

RA-L 2025

Building accurate and reliable maps is a critical requirement for autonomous robots. In this paper, we propose UN3-Mapping, an implicit neural mapping method that enables high-quality 3D reconstruction with integrated uncertainty estimation. Our approach employs a hybrid representation: an implicit

Cited by 0SourcecodeScholar
2024

Focus On What Matters: Separated Models For Visual-Based RL Generalization

NeurIPS 2024poster

A primary challenge for visual-based Reinforcement Learning (RL) is to generalize effectively across unseen environments. Although previous studies have explored different auxiliary tasks to enhance generalization, few adopt image reconstruction due to concerns about exacerbating overfitting to task…

Cited by 2SourcePDFScholar
2024

LIMOT: A Tightly-Coupled System for LiDAR-Inertial Odometry and Multi-Object Tracking

RA-L 2024

Simultaneous localization and mapping (SLAM) is essential for autonomous driving. Most LiDAR-inertial SLAM algorithms assume a static environment, leading to unreliable localization in dynamic environments. Moreover, the accurate tracking of moving objects is of great significance for the control an

Cited by 9SourcecodeScholar
2024

LOG-LIO2: A LiDAR-Inertial Odometry With Efficient Uncertainty Analysis

RA-L 2024

Uncertainty in LiDAR measurements, stemming from factors such as range sensing, is crucial for LIO (LiDAR-Inertial Odometry) systems as it affects the accurate weighting in the loss function. While recent LIO systems address uncertainty related to range sensing, the impact of incident angle on uncer

Cited by 8SourcecodeScholar
2024

LOG-LIO: A LiDAR-Inertial Odometry With Efficient Local Geometric Information Estimation

RA-L 2024

Local geometric information, i.e., normal and distribution of points, is crucial for LiDAR-based simultaneous localization and mapping (SLAM) because it provides constraints for data association, which further determines the direction of optimization and ultimately affects the accuracy of localizati

Cited by 19SourcecodeScholar
2024

Learning Sequence Descriptor Based on Spatio-Temporal Attention for Visual Place Recognition

RA-L 2024

Visual Place Recognition (VPR) aims to retrieve frames from a geotagged database that are located at the same place as the query frame. To improve the robustness of VPR in perceptually aliasing scenarios, sequence-based VPR methods are proposed. These methods are either based on matching between fra

Cited by 12SourcecodeScholar
2024

N${3}$-Mapping: Normal Guided Neural Non-Projective Signed Distance Fields for Large-Scale 3D Mapping

RA-L 2024

Accurate and dense mapping in large-scale environments is essential for various robot applications. Recently, implicit neural signed distance fields (SDFs) have shown promising advances in this task. However, most existing approaches employ projective distances from range data as SDF supervision, in

Cited by 12SourcecodeScholar
2024

Safe Reinforcement Learning With Dead-Ends Avoidance and Recovery

RA-L 2024

Safety is one of the main challenges in applying reinforcement learning to tasks in realistic environments. To ensure safety during and after the training process, existing methods tend to adopt overly conservative policies to avoid unsafe situations. However, an overly conservative policy severely

Cited by 10SourceScholar
2024

Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning

NeurIPS 2024spotlight

As a marriage between offline RL and meta-RL, the advent of offline meta-reinforcement learning (OMRL) has shown great promise in enabling RL agents to multi-task and quickly adapt while acquiring knowledge safely. Among which, context-based OMRL (COMRL) as a popular paradigm, aims to learn a univer…

2023

How to Fine-tune the Model: Unified Model Shift and Model Bias Policy Optimization

NeurIPS 2023poster

Designing and deriving effective model-based reinforcement learning (MBRL) algorithms with a performance improvement guarantee is challenging, mainly attributed to the high coupling between model learning and policy optimization. Many prior methods that rely on return discrepancy to guide model lear…

Cited by 9SourcePDFScholar
2022

LIO-Vehicle: A Tightly-Coupled Vehicle Dynamics Extension of LiDAR Inertial Odometry

RA-L 2022

We propose LIO-Vehicle, a new tightly-coupled vehicle dynamics extension of LiDAR inertial odometry (LIO) method that provides highly accurate, robust, and real-time vehicle trajectory estimation. Since most existing LiDAR-based localization methods are not specifically proposed for vehicles, they d

Cited by 20SourceScholar
2022

Scale Estimation with Dual Quadrics for Monocular Object SLAM

IROS 2022poster

The scale ambiguity problem is inherently unsolvable to monocular SLAM without the metric baseline between moving cameras. In this paper, we present a novel scale estimation approach based on an object-level SLAM system. To obtain the absolute scale of the reconstructed map, we formulate an optimiza…

Cited by 7SourceScholar
2021

GPU-Efficient Dense Convolutional Network for Real-time Semantic Segmentation

ICRA 2021poster

Real-time semantic segmentation is a challenging task as both accuracy and inference speed need to be considered simultaneously. In real-world applications, it is usually achieved by deploying a deep neural network in modern GPU device. However, most of the work focused on real-time semantic segment…

Cited by 1SourceScholar
2021

Robust Dual Quadric Initialization for Forward-Translating Camera Movements

RA-L 2021

Herein, we present a novel approach for monocular dual quadric initialization that combines three-dimensional (3D) map points with two-dimensional (2D) object detection for forward-translating camera movements. The traditional approach using 2D detection bounding boxes in multiple views fails in str

Cited by 11SourceScholar
2019

DFNet: Semantic Segmentation on Panoramic Images with Dynamic Loss Weights and Residual Fusion Block

ICRA 2019poster

For the domain of self-driving and automatic parking, perception is a basic and critical technique, moreover, the detection of lane markings and parking slots is an important part of visual perception. Compared with front sight images, panoramic images(PI) can capture more comprehensive pavement inf…

Cited by 27SourceScholar