← Search

Simon Sinong Zhan

7 accepted papers

2026

Belief-Based Offline Reinforcement Learning for Delay-Robust Policy Optimization

ICLR 2026poster

Offline–to–online deployment of reinforcement learning (RL) agents often stumbles over two fundamental gaps: (1) the sim-to-real gap, where real-world systems exhibit latency and other physical imperfections not captured in simulation; and (2) the interaction gap, where policies trained purely offli…

Cited by 0SourcecodeScholar
2026

Shop-R1: Rewarding LLMs to Simulate Human Behavior in Online Shopping via Reinforcement Learning

ICLR 2026poster

Large Language Models (LLMs) have recently demonstrated strong potential in generating ‘believable human-like’ behavior in web environments. Prior work has explored augmenting training data with LLM-synthesized rationales and applying supervised fine-tuning (SFT) to enhance reasoning ability, which…

Cited by 0SourcecodeScholar
2025

Directly Forecasting Belief for Reinforcement Learning with Delays

ICML 2025poster

Reinforcement learning (RL) with delays is challenging as sensory perceptions lag behind the actual events: the RL agent needs to estimate the real state of its environment based on past observations. State-of-the-art (SOTA) methods typically employ recursive, step-by-step forecasting of states. Thi…

2024

Boosting Reinforcement Learning with Strongly Delayed Feedback Through Auxiliary Short Delays

ICML 2024poster

Reinforcement learning (RL) is challenging in the common case of delays between events and their sensory perceptions. State-of-the-art (SOTA) state augmentation techniques either suffer from state space explosion or performance degeneration in stochastic environments. To address these challenges, we…

2024

Kinematics-aware Trajectory Generation and Prediction with Latent Stochastic Differential Modeling

IROS 2024poster

Trajectory generation and trajectory prediction are two critical tasks in autonomous driving, which generate various trajectories for testing during development and predict the trajectories of surrounding vehicles during operation, respectively. In recent years, emerging data-driven deep learning-ba…

Cited by 6SourceScholar
2024

Variational Delayed Policy Optimization

NeurIPS 2024spotlight

In environments with delayed observation, state augmentation by including actions within the delay window is adopted to retrieve Markovian property to enable reinforcement learning (RL). Whereas, state-of-the-art (SOTA) RL techniques with Temporal-Difference (TD) learning frameworks commonly suffer…

2023

Enforcing Hard Constraints with Soft Barriers: Safe Reinforcement Learning in Unknown Stochastic Environments

ICML 2023poster

It is quite challenging to ensure the safety of reinforcement learning (RL) agents in an unknown and stochastic environment under hard constraints that require the system state not to reach certain specified unsafe regions. Many popular safe RL methods such as those based on the Constrained Markov D…

Cited by 54SourcePDFScholar