Sim2Real Transfer for Reinforcement Learning without Dynamics Randomization
Manuel Kaspar, Juan D. Muñoz Osorio, Juergen Bock
Abstract
We show how to use the Operational Space Control framework (OSC) under joint and Cartesian constraints for reinforcement learning in Cartesian space. Our method is able to learn fast and with adjustable degrees of freedom, while we are able to transfer policies without additional dynamics randomizations on a KUKA LBR iiwa peg-in-hole task. Before learning in simulation starts, we perform a system identification for aligning the simulation environment as far as possible with the dynamics of a real robot. Adding constraints to the OSC controller allows us to learn in a safe way on the real robot or to learn a flexible, goal conditioned policy that can be easily transferred from simulation to the real robot.
BibTeX
@inproceedings{iros2020_sim2realtransfer,
title = {Sim2Real Transfer for Reinforcement Learning without Dynamics Randomization},
author = {Manuel Kaspar and Juan D. Muñoz Osorio and Juergen Bock},
booktitle = {IROS 2020},
year = {2020}
}