← Search

Michael Lutter

8 accepted papers

2023

Diminishing Return of Value Expansion Methods in Model-Based Reinforcement Learning

ICLR 2023poster

Model-based reinforcement learning is one approach to increase sample efficiency. However, the accuracy of the dynamics model and the resulting compounding error over modelled trajectories are commonly regarded as key limitations. A natural question to ask is: How much more sample efficiency can be…

2021

Differentiable Physics Models for Real-world Offline Model-based Reinforcement Learning

ICRA 2021poster

A limitation of model-based reinforcement learning (MBRL) is the exploitation of errors in the learned models. Blackbox models can fit complex dynamics with high fidelity, but their behavior is undefined outside of the data distribution. Physics-based models are better at extrapolating, due to the g…

Cited by 44SourceScholar
2021

Robust Value Iteration for Continuous Control Tasks

RSS 2021poster

When transferring a control policy from simulation to a physical system; this policy needs to be robust to variations in the dynamics to perform well. Commonly; the optimal policy overfits to the approximate model and the corresponding state-distribution. Therefore; the policy fails when transferred…

Cited by 18SourcePDFScholar
2021

Value Iteration in Continuous Actions, States and Time

ICML 2021spotlight

Classical value iteration approaches are not applicable to environments with continuous states and actions. For such environments the states and actions must be discretized, which leads to an exponential increase in computational complexity. In this paper, we propose continuous fitted value iteratio…

2020

High Acceleration Reinforcement Learning for Real-World Juggling with Binary Rewards

CoRL 2020

Robots that can learn in the physical world will be important to enable robots to escape their stiff and pre-programmed movements. For dynamic high-acceleration tasks, such as juggling, learning in the real-world is particularly challenging as one must push the limits of the robot and its actuation

2019

Deep Lagrangian Networks for end-to-end learning of energy-based control for under-actuated systems

IROS 2019poster

Applying Deep Learning to control has a lot of potential for enabling the intelligent design of robot control laws. Unfortunately common deep learning approaches to control, such as deep reinforcement learning, require an unrealistic amount of interaction with the real system, do not yield any perfo…

Cited by 92SourceScholar
2019

Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learning

ICLR 2019poster

Deep learning has achieved astonishing results on many tasks with large amounts of data and generalization within the proximity of training data. For many important real-world applications, these requirements are unfeasible and additional prior knowledge on the task domain is required to overcome th…

Cited by 511SourcePDFScholar
2019

HJB Optimal Feedback Control with Deep Differential Value Functions and Action Constraints

CoRL 2019

Learning optimal feedback control laws capable of executing optimal trajectories is essential for many robotic applications. Such policies can be learned using reinforcement learning or planned using optimal control. While reinforcement learning is sample inefficient, optimal control only plans an o

Cited by 0SourcePDFScholar