← Search

Haoran He

12 accepted papers

2026

Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewards

ICLR 2026poster

RL with Verifiable Rewards (RLVR) has emerged as a promising paradigm for improving the reasoning abilities of large language models (LLMs). Current methods rely primarily on policy optimization frameworks like PPO and GRPO, which follow generalized policy iteration that alternates between evaluatin…

Cited by 0SourcecodeScholar
2025

Looking Backward: Retrospective Backward Synthesis for Goal-Conditioned GFlowNets

ICLR 2025poster

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have demonstrated remarkable capabilities to generate diverse sets of high-reward candidates, in contrast to standard return maximization approaches (e.g., reinforcement learning) which often converge to a single optimal s…

2025

Random Policy Evaluation Uncovers Policies of Generative Flow Networks

ICML 2025poster

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects with probability proportional to an unnormalized reward function. GFlowNets share a strong connection with reinforcement learning (RL) that typically…

Cited by 0SourcePDFScholar
2025

Task-Agnostic Pre-training and Task-Guided Fine-tuning for Versatile Diffusion Planner

ICML 2025poster

Diffusion models have demonstrated their capabilities in modeling trajectories of multi-tasks. However, existing multi-task planners or policies typically rely on task-specific demonstrations via multi-task imitation, or require task-specific reward labels to facilitate policy optimization via Reinf…

Cited by 0SourcePDFScholar
2024

Bridging the Sim-to-Real Gap from the Information Bottleneck Perspective

CoRL 2024poster

Reinforcement Learning (RL) has recently achieved remarkable success in robotic control. However, most works in RL operate in simulated environments where privileged knowledge (e.g., dynamics, surroundings, terrains) is readily available. Conversely, in real-world scenarios, robot agents usually rel…

Cited by 9SourcecodeScholar
2024

Learning an Actionable Discrete Diffusion Policy via Large-Scale Actionless Video Pre-Training

NeurIPS 2024poster

Learning a generalist embodied agent capable of completing multiple tasks poses challenges, primarily stemming from the scarcity of action-labeled robotic datasets. In contrast, a vast amount of human videos exist, capturing intricate tasks and interactions with the physical world. Promising prospec…

2024

Regularized Conditional Diffusion Model for Multi-Task Preference Alignment

NeurIPS 2024poster

Sequential decision-making can be formulated as a conditional generation process, with targets for alignment with human intents and versatility across various tasks. Previous return-conditioned diffusion models manifest comparable performance but rely on well-defined reward functions, which requires…

Cited by 7SourcePDFScholar
2024

Robust Quadrupedal Locomotion via Risk-Averse Policy Learning

ICRA 2024poster

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged distillation, scene modeling, and external sensors to improve the gene…

Cited by 13SourceScholar
2024

SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation

ICML 2024poster

Acquiring a multi-task imitation policy in 3D manipulation poses challenges in terms of scene understanding and action prediction. Current methods employ both 3D representation and multi-view 2D representation to predict the poses of the robot’s end-effector. However, they still require a considerab…

Cited by 11SourcePDFScholar
2023

Design and Longitudinal Dynamics Decoupling Control of a Tilt-Rotor Aerial Vehicle With High Maneuverability and Efficiency

RA-L 2023

The widespread application of Unmanned Aerial Vehicles (UAVs) brings a higher demand for their interaction capabilities, highlighting the improvements in UAVs’ maneuverability and efficiency. Most existing design schemes of fully-actuated aerial vehicles have disadvantages, such as thrust offset and

Cited by 19SourceScholar
2023

Diffusion Model is an Effective Planner and Data Synthesizer for Multi-Task Reinforcement Learning

NeurIPS 2023poster

Diffusion models have demonstrated highly-expressive generative capabilities in vision and NLP. Recent studies in reinforcement learning (RL) have shown that diffusion models are also powerful in modeling complex policies or trajectories in offline datasets. However, these works have been limited to…