← Search

Zhanyi Sun

7 accepted papers

2026

From Prior to Pro: Efficient Skill Mastering via Distribution Contractive RL Finetuning

ICML 2026poster

We introduce Distribution Contractive Reinforcement Learning (DICE-RL), a framework that uses reinforcement learning (RL) as a “distribution contractor” to refine pretrained generative robot policies. DICE-RL turns a pretrained behavior prior into a high-performing “pro” policy by amplifying high-su…

Cited by 0SourcecodeScholar
2025

Latent Policy Barrier: Learning Robust Visuomotor Policies by Staying In-Distribution

NeurIPS 2025spotlight

Visuomotor policies trained via behavior cloning are vulnerable to covariate shift, where small deviations from expert trajectories can compound into failure. Common strategies to mitigate this issue involve expanding the training distribution through human-in-the-loop corrections or synthetic data…

Cited by 0SourcecodeScholar
2024

Force-Constrained Visual Policy: Safe Robot-Assisted Dressing via Multi-Modal Sensing

RA-L 2024

Robot-assisted dressing could profoundly enhance the quality of life of adults with physical disabilities. To achieve this, a robot can benefit from both visual and force sensing. The former enables the robot to ascertain human body pose and garment deformations, while the latter helps maintain safe

Cited by 23SourceScholar
2024

RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedback

ICML 2024poster

Reward engineering has long been a challenge in Reinforcement Learning (RL) research, as it often requires extensive human effort and iterative processes of trial-and-error to design effective reward functions. In this paper, we propose RL-VLM-F, a method that automatically generates reward function…

2023

One Policy to Dress Them All: Learning to Dress People with Diverse Poses and Garments

RSS 2023poster

Robot-assisted dressing could benefit the lives of many people such as older adults and individuals with disabilities. Despite such potential, robot-assisted dressing remains a challenging task for robotics as it involves complex manipulation of deformable cloth in 3D space. Many prior works aim to…

Cited by 21SourcePDFScholar
2022

Human-Guided Motion Planning in Partially Observable Environments

ICRA 2022poster

Motion planning is a core problem in robotics, with a range of existing methods aimed to address its diverse set of challenges. However, most existing methods rely on complete knowledge of the robot environment; an assumption that seldom holds true due to inherent limitations of robot perception. To…

Cited by 10SourceScholar
2022

SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning

ECCV 2022poster

"Neural architecture search (NAS) has demonstrated amazing success in searching for efficient deep neural networks (DNNs) from a given supernet. In parallel, the lottery ticket hypothesis has shown that DNNs contain small subnetworks that can be trained from scratch to achieve a comparable or higher…