← Search

Pierre Schumacher

5 accepted papers

2026

Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Control

ICLR 2026poster

Contact forces introduce discontinuities into robot dynamics that severely limit the use of simulators for gradient-based optimization. Penalty-based simulators such as MuJoCo, soften contact resolution to enable gradient computation. However, realistically simulating hard contacts requires stiff so…

Cited by 0SourceScholar
2025

MyoChallenge 2024: A New Benchmark for Physiological Dexterity and Agility in Bionic Humans

NeurIPS 2025poster

Recent advancements in bionic prosthetic technology offer transformative opportunities to restore mobility and functionality for individuals with missing limbs. Users of bionic limbs, or bionic humans, learn to seamlessly integrate prosthetic extensions into their motor repertoire, regaining critica…

Cited by 0SourceScholar
2024

Identifying Policy Gradient Subspaces

ICLR 2024poster

Policy gradient methods hold great potential for solving complex continuous control tasks. Still, their training efficiency can be improved by exploiting structure within the optimization problem. Recent work indicates that supervised learning can be accelerated by leveraging the fact that gradients…

Cited by 2SourcePDFScholar
2023

DEP-RL: Embodied Exploration for Reinforcement Learning in Overactuated and Musculoskeletal Systems

ICLR 2023top-25%

Muscle-actuated organisms are capable of learning an unparalleled diversity of dexterous movements despite their vast amount of muscles. Reinforcement learning (RL) on large musculoskeletal models, however, has not been able to show similar performance. We conjecture that ineffective exploration…

2022

Learning with Muscles: Benefits for Data-Efficiency and Robustness in Anthropomorphic Tasks

CoRL 2022poster

Humans are able to outperform robots in terms of robustness, versatility, and learning of new tasks in a wide variety of movements. We hypothesize that highly nonlinear muscle dynamics play a large role in providing inherent stability, which is favorable to learning. While recent advances have been…

Cited by 13SourceScholar