← Search

Tianyuan Chen

2 accepted papers

2025

ACTIVE: Offline Reinforcement Learning via Adaptive Imitation and In-sample $V$-Ensemble

ICLR 2025poster

Offline reinforcement learning (RL) aims to learn from static datasets and thus faces the challenge of value estimation errors for out-of-distribution actions. The in-sample learning scheme addresses this issue by performing implicit TD backups that does not query the values of unseen actions. Howev…

Cited by 0Source ↗PDF ↗Scholar ↗
2025

Offline RL with Smooth OOD Generalization in Convex Hull and its Neighborhood

ICLR 2025poster

Offline Reinforcement Learning (RL) struggles with distributional shifts, leading to the $Q$-value overestimation for out-of-distribution (OOD) actions. Existing methods address this issue by imposing constraints; however, they often become overly conservative when evaluating OOD regions, which cons…