← Search

Yuanlin Duan

5 accepted papers

2026

Preference-based Policy Optimization from Sparse-reward Offline Dataset

ICLR 2026poster

Offline reinforcement learning (RL) holds the promise of training effective policies from static datasets without the need for costly online interactions. However, offline RL faces key limitations, most notably the challenge of generalizing to unseen or infrequently encountered state-action pairs. W…

Cited by 0SourceScholar
2024

Exploring the Edges of Latent State Clusters for Goal-Conditioned Reinforcement Learning

NeurIPS 2024poster

Exploring unknown environments efficiently is a fundamental challenge in unsupervised goal-conditioned reinforcement learning. While selecting exploratory goals at the frontier of previously explored states is an effective strategy, the policy during training may still have limited capability of rea…

2024

MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition

EMNLP 2024finding

The emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models. Compared to traditional LLMs, MoE LLMs outperform traditional LLMs by achieving higher performance with considerably fewer activated parameters. Despite this efficiency, their enormous param…