← Search

Jiayi Guan

4 accepted papers

2026

SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models

ICML 2026oral

Vision-Language Models (VLMs) perform well on commonsense reasoning tasks but struggle with visual spatial reasoning. Most existing solutions introduce extra 3D priors or external spatial encoders, which increase complexity and degrade the underlying VLMs' general-purpose capabilities after spatial …

Cited by 0SourceScholar
2025

CHPO: Constrained Hybrid-action Policy Optimization for Reinforcement Learning

NeurIPS 2025poster

Constrained hybrid-action reinforcement learning (RL) promises to learn a safe policy within a parameterized action space, which is particularly valuable for safety-critical applications involving discrete-continuous hybrid action spaces. However, existing hybrid-action RL algorithms primarily focus…

Cited by 0SourceScholar
2024

POCE: Primal Policy Optimization with Conservative Estimation for Multi-constraint Offline Reinforcement Learning

CVPR 2024poster

Multi-constraint offline reinforcement learning (RL) promises to learn policies that satisfy both cumulative and state-wise costs from offline datasets. This arrangement provides an effective approach for the widespread application of RL in high-risk scenarios where both cumulative and state-wise co…

2023

VOCE: Variational Optimization with Conservative Estimation for Offline Safe Reinforcement Learning

NeurIPS 2023poster

Offline safe reinforcement learning (RL) algorithms promise to learn policies that satisfy safety constraints directly in offline datasets without interacting with the environment. This arrangement is particularly important in scenarios with high sampling costs and potential dangers, such as autonom…