← Search

Junyin Ye

7 accepted papers

2026

Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation

ICML 2026poster

While current embodied policies exhibit remarkable manipulation skills, their execution remains unsatisfactorily slow as they inherit the tardy pacing of human demonstrations. Existing acceleration methods typically require policy retraining or costly online interactions, limiting their scalability …

Cited by 0SourceScholar
2025

Any-step Dynamics Model Improves Future Predictions for Online and Offline Reinforcement Learning

ICLR 2025poster

Model-based methods in reinforcement learning offer a promising approach to enhance data efficiency by facilitating policy exploration within a dynamics model. However, accurately predicting sequential steps in the dynamics model remains a challenge due to the bootstrapping prediction, which attribu…

2024

Deep Demonstration Tracing: Learning Generalizable Imitator Policy for Runtime Imitation from a Single Demonstration

ICML 2024poster

One-shot imitation learning (OSIL) is to learn an imitator agent that can execute multiple tasks with only a single demonstration. In real-world scenario, the environment is dynamic, e.g., unexpected changes can occur after demonstration. Thus, achieving generalization of the imitator agent is cruci…

2024

Episodic Return Decomposition by Difference of Implicitly Assigned Sub-trajectory Reward

AAAI 2024technical

Real-world decision-making problems are usually accompanied by delayed rewards, which affects the sample efficiency of Reinforcement Learning, especially in the extremely delayed case where the only feedback is the episodic reward obtained at the end of an episode. Episodic return decomposition is a…

2024

Flow to Better: Offline Preference-based Reinforcement Learning via Preferred Trajectory Generation

ICLR 2024poster

Offline preference-based reinforcement learning (PbRL) offers an effective solution to overcome the challenges associated with designing rewards and the high costs of online interactions. In offline PbRL, agents are provided with a fixed dataset containing human preferences between pairs of trajecto…

Cited by 20SourcePDFScholar
2024

Limited Preference Aided Imitation Learning from Imperfect Demonstrations

ICML 2024poster

Imitation learning mimics high-quality policies from expert data for sequential decision-making tasks. However, its efficacy is hindered in scenarios where optimal demonstrations are unavailable, and only imperfect demonstrations are present. To address this issue, introducing additional limited hum…

Cited by 1SourcePDFScholar
2023

Model-Bellman Inconsistency for Model-based Offline Reinforcement Learning

ICML 2023poster

For offline reinforcement learning (RL), model-based methods are expected to be data-efficient as they incorporate dynamics models to generate more data. However, due to inevitable model errors, straightforwardly learning a policy in the model typically fails in the offline setting. Previous studies…