← Search

Haoyi Niu

9 accepted papers

2025

Are Expressive Models Truly Necessary for Offline RL?

AAAI 2025technical

Among various branches of offline reinforcement learning (RL) methods, goal-conditioned supervised learning (GCSL) has gained increasing popularity as it formulates the offline RL problem as a sequential modeling task, therefore bypassing the notoriously difficult credit assignment challenge of valu…

2025

Efficient Robotic Policy Learning via Latent Space Backward Planning

ICML 2025poster

Current robotic planning methods often rely on predicting multi-frame images with full pixel details. While this fine-grained approach can serve as a generic world model, it introduces two significant challenges for downstream policy learning: substantial computational costs that hinder real-time de…

2025

H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps

ICRA 2025

Solving real-world complex tasks using reinforcement learning (RL) without high-fidelity simulation environments or large amounts of offline data can be quite challenging. Online RL agents trained in imperfect simulation environments can suffer from severe sim-to-real issues. Offline RL approaches a

Cited by 17SourceScholar
2025

Skill Expansion and Composition in Parameter Space

ICLR 2025poster

Humans excel at reusing prior knowledge to address new challenges and developing skills while solving problems. This paradigm becomes increasingly popular in the development of autonomous agents, as it develops systems that can self-evolve in response to new challenges like human beings. However, pr…

2024

A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents

IJCAI 2024poster

The burgeoning fields of robot learning and embodied AI have triggered an increasing demand for large quantities of data. However, collecting sufficient unbiased data from the target domain remains a challenge due to costly data collection processes and stringent safety requirements. Consequently, r…

2024

Continual Driving Policy Optimization with Closed-Loop Individualized Curricula

ICRA 2024poster

The safety of autonomous vehicles (AV) has been a long-standing top concern, stemming from the absence of rare and safety-critical scenarios in the long-tail naturalistic driving distribution. To tackle this challenge, a surge of research in scenario-based autonomous driving has emerged, with a focu…

Cited by 3SourcecodeScholar
2024

DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning

ICML 2024poster

Multimodal pretraining is an effective strategy for the trinity of goals of representation learning in autonomous robots: $1)$ extracting both local and global task progressions; $2)$ enforcing temporal consistency of visual representation; $3)$ capturing trajectory-level language grounding. Most ex…

2022

Discriminator-Guided Model-Based Offline Imitation Learning

CoRL 2022poster

Offline imitation learning (IL) is a powerful method to solve decision-making problems from expert demonstrations without reward labels. Existing offline IL methods suffer from severe performance degeneration under limited expert data. Including a learned dynamics model can potentially improve the s…

Cited by 22SourceScholar
2022

When to Trust Your Simulator: Dynamics-Aware Hybrid Offline-and-Online Reinforcement Learning

NeurIPS 2022accept

Learning effective reinforcement learning (RL) policies to solve real-world complex tasks can be quite challenging without a high-fidelity simulation environment. In most cases, we are only given imperfect simulators with simplified dynamics, which inevitably lead to severe sim-to-real gaps in RL po…