← Search

Pengyuan Wang

12 accepted papers

2026

Clipping Low-Probability Tokens in SFT Yields a Generalizable Initialization for RL

ICML 2026poster

Supervised Fine-Tuning (SFT) is a critical step for adapting Large Language Models (LLMs) to specialized domains, often serving as an initialization for subsequent reinforcement learning (RL). However, SFT can overfit a small set of expert data, harming generalization and eroding prior knowledge. Th…

Cited by 0SourceScholar
2025

Controlling Large Language Model with Latent Action

ICML 2025poster

Adapting Large Language Models (LLMs) to downstream tasks using Reinforcement Learning (RL) has proven to be an effective approach. However, LLMs do not inherently define the structure of an agent for RL training, particularly in terms of specifying the action space. This paper studies learning a co…

Cited by 0SourcePDFScholar
2025

Multi-Agent Imitation by Learning and Sampling from Factorized Soft Q-Function

NeurIPS 2025poster

Learning from multi-agent expert demonstrations, known as Multi-Agent Imitation Learning (MAIL), provides a promising approach to sequential decision-making. However, existing MAIL methods including Behavior Cloning (BC) and Adversarial Imitation Learning (AIL) face significant challenges: BC suffer…

Cited by 0SourcecodeScholar
2025

Semantic Temporal Abstraction via Vision-Language Model Guidance for Efficient Reinforcement Learning

ICLR 2025poster

Extracting temporally extended skills can significantly improve the efficiency of reinforcement learning (RL) by breaking down complex decision-making problems with sparse rewards into simpler subtasks and enabling more effective credit assignment. However, existing abstraction methods either discov…

Cited by 0SourcePDFScholar
2024

Design and validation of slender extensible continuum robot for solar wing re-unfolding in aerospace

ICRA 2024poster

The solar array wing deployment of orbiting satellites cannot be performed due to power failure of the connector caused by uncertain loads such as high temperature or vibration in the launching process of the spacecraft. There is currently a lack of suitable unlocking solutions for solar wing re-unf…

Cited by 0SourceScholar
2024

HouseCat6D - A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarios

CVPR 2024highlight

Estimating 6D object poses is a major challenge in 3D computer vision. Building on successful instance-level approaches research is shifting towards category-level pose estimation for practical applications. Current category-level datasets however fall short in annotation quality and pose variety. A…

2024

Improving Self-Supervised Learning of Transparent Category Poses With Language Guidance and Implicit Physical Constraints

RA-L 2024

Accurate object pose estimation is crucial for robotic applications and recent trends in category-level pose estimation show great potential for applications encountering a large variety of similar objects, often encountered in home environments. While common in such environments, photometrically ch

Cited by 1SourceScholar
2024

Language Model Self-improvement by Reinforcement Learning Contemplation

ICLR 2024poster

Language model self-improvement (LMSI) techniques have recently gained significant attention as they improve language models without requiring external supervision. A common approach is reinforcement learning from AI feedback (RLAIF), which trains a reward model based on AI preference data and emplo…

Cited by 41SourcePDFScholar
2022

PhoCaL: A Multi-Modal Dataset for Category-Level Object Pose Estimation With Photometrically Challenging Objects

CVPR 2022poster

Object pose estimation is crucial for robotic applications and augmented reality. Beyond instance level 6D object pose estimation methods, estimating category-level pose and shape has become a promising trend. As such, a new research field needs to be supported by well-designed datasets. To provide…

Cited by 54PDFScholar
2022

Polarimetric Pose Prediction

ECCV 2022poster

"Light has many properties that vision sensors can passively measure. Colour-band separated wavelength and intensity are arguably the most commonly used for monocular 6D object pose estimation. This paper explores how complementary polarisation information, i.e. the orientation of light wave oscilla…

Cited by 33SourcePDFScholar
2021

DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstration

IROS 2021poster

The ability to successfully grasp objects is crucial in robotics, as it enables several interactive downstream applications. To this end, most approaches either compute the full 6D pose for the object of interest or learn to predict a set of grasping points. While the former approaches do not scale…

Cited by 38SourceScholar
2016

Distributed Flexible Nonlinear Tensor Factorization

NeurIPS 2016poster

Tensor factorization is a powerful tool to analyse multi-way data. Recently proposed nonlinear factorization methods, although capable of capturing complex relationships, are computationally quite expensive and may suffer a severe learning bias in case of extreme data sparsity. Therefore, we propose…

Cited by 78SourcePDFScholar