← Search

Andreas Doerr

7 accepted papers

2020

Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization

ICLR 2020spotlight

Transferring knowledge across tasks to improve data-efficiency is one of the open key challenges in the field of global black-box optimization. Readily available algorithms are typically designed to be universal optimizers and, therefore, often suboptimal for specific tasks. We propose a novel trans…

Cited by 100SourceScholar
2019

Trajectory-Based Off-Policy Deep Reinforcement Learning

ICML 2019oral

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently get stuck in local optima. This work addresses these weakne…

2018

Learning Gaussian Processes by Minimizing PAC-Bayesian Generalization Bounds

NeurIPS 2018poster

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To this end, we propose a method to learn GPs and their sparse…

2018

Probabilistic Recurrent State-Space Models

ICML 2018oral

State-space models (SSMs) are a highly expressive model class for learning patterns in time series data and for system identification. Deterministic versions of SSMs (e.g., LSTMs) proved extremely successful in modeling complex time series data. Fully probabilistic SSMs, however, are often found har…

2017

Model-based policy search for automatic tuning of multivariate PID controllers

ICRA 2017poster

PID control architectures are widely used in industrial applications. Despite their low number of open parameters, tuning multiple, coupled PID controllers can become tedious in practice. In this paper, we extend PILCO, a model-based policy search framework, to automatically tune multivariate PID co…

Cited by 49SourceScholar
2017

Optimizing Long-term Predictions for Model-based Policy Search

CoRL 2017

We propose a novel long-term optimization criterion to improve the robustness of model-based reinforcement learning in real-world scenarios. Learning a dynamics model to derive a solution promises much greater data-efficiency and reusability compared to model-free alternatives. In practice, however,

2015

Direct Loss Minimization Inverse Optimal Control

RSS 2015poster

Inverse Optimal Control (IOC) has strongly impacted the systems engineering process, enabling automated planner tuning through straightforward and intuitive demonstration. The most successful and established applications, though, have been in lower dimensional problems such as navigation planning wh…

Cited by 57SourcePDFScholar