← Search

Shangqun Yu

5 accepted papers

2024

StaccaToe: A Single-Leg Robot that Mimics the Human Leg and Toe

IROS 2024poster

We introduce StaccaToe, a human-scale, electric motor-powered single-leg robot designed to rival the agility of human locomotion through two distinctive attributes: an actuated toe and a co-actuation configuration inspired by the human leg. Leveraging the foundational design of HyperLeg’s lower leg…

Cited by 1SourceScholar
2023

Meta-learning Parameterized Skills

ICML 2023poster

We propose a novel parameterized skill-learning algorithm that aims to learn transferable parameterized skills and synthesize them into a new action space that supports efficient learning in long-horizon tasks. We propose to leverage off-policy Meta-RL combined with a trajectory-centric smoothness t…

2023

Q-functionals for Value-Based Continuous Control

AAAI 2023technical

We present Q-functionals, an alternative architecture for continuous control deep reinforcement learning. Instead of returning a single value for a state-action pair, our network transforms a state into a function that can be rapidly evaluated in parallel for many actions, allowing us to efficiently…

2022

Model-based Lifelong Reinforcement Learning with Bayesian Exploration

NeurIPS 2022accept

We propose a model-based lifelong reinforcement-learning approach that estimates a hierarchical Bayesian posterior distilling the common structure shared across different tasks. The learned posterior combined with a sample-based Bayesian exploration procedure increases the sample efficiency of learn…