← Search

Qing-Shan Jia

7 accepted papers

2026

COLLIE: Guiding Skill Discovery in Semantically Coherent Latent Space

ICML 2026poster

Unsupervised skill discovery (USD) aims to learn diverse behaviors without reward functions, but often results in task-irrelevant or hazardous behaviors due to uniform exploration. Guided skill discovery (GSD) addresses this issue by incorporating human intent to focus exploration on meaningful regi…

Cited by 0SourceScholar
2025

CLARIFY: Contrastive Preference Reinforcement Learning for Untangling Ambiguous Queries

ICML 2025poster

Preference-based reinforcement learning (PbRL) bypasses explicit reward engineering by inferring reward functions from human preference comparisons, enabling better alignment with human intentions. However, humans often struggle to label a clear preference between similar segments, reducing label ef…

2025

S-EPOA: Overcoming the Indistinguishability of Segments with Skill-Driven Preference-Based Reinforcement Learning

IJCAI 2025

Preference-based reinforcement learning (PbRL) stands out by utilizing human preferences as a direct reward signal, eliminating the need for intricate reward engineering. However, despite its potential, traditional PbRL methods are often constrained by the indistinguishability of segments, which imp

Cited by 0SourcePDFScholar
2025

STAIR: Addressing Stage Misalignment through Temporal-Aligned Preference Reinforcement Learning

NeurIPS 2025poster

Preference-based reinforcement learning (PbRL) bypasses complex reward engineering by learning rewards directly from human preferences, enabling better alignment with human intentions. However, its effectiveness in multi-stage tasks, where agents sequentially perform sub-tasks (e.g., navigation, gra…

Cited by 0SourceScholar
2024

Query-Policy Misalignment in Preference-Based Reinforcement Learning

ICLR 2024spotlight

Preference-based reinforcement learning (PbRL) provides a natural way to align RL agents’ behavior with human desired outcomes, but is often restrained by costly human feedback. To improve feedback efficiency, most existing PbRL methods focus on selecting queries to maximally improve the overall qua…

2023

Mind the Gap: Offline Policy Optimization for Imperfect Rewards

ICLR 2023poster

Reward function is essential in reinforcement learning (RL), serving as the guiding signal to incentivize agents to solve given tasks, however, is also notoriously difficult to design. In many cases, only imperfect rewards are available, which inflicts substantial performance loss for RL agents. In…