ICLR 2020poster107 citations

Making Efficient Use of Demonstrations to Solve Hard Exploration Problems

Caglar Gulcehre, Tom Le Paine, Bobak Shahriari, Misha Denil, Matt Hoffman, Hubert Soyer, Richard Tanburn, Steven Kapturowski

Abstract

This paper introduces R2D3, an agent that makes efficient use of demonstrations to solve hard exploration problems in partially observable environments with highly variable initial conditions. We also introduce a suite of eight tasks that combine these three properties, and show that R2D3 can solve several of the tasks where other state of the art methods (both with and without demonstrations) fail to see even a single successful trajectory after tens of billions of steps of exploration.

imitation learningdeep learningreinforcement learning
BibTeX
@inproceedings{
Gulcehre2020Making,
title={Making Efficient Use of Demonstrations to Solve Hard Exploration Problems},
author={Caglar Gulcehre and Tom Le Paine and Bobak Shahriari and Misha Denil and Matt Hoffman and Hubert Soyer and Richard Tanburn and Steven Kapturowski and Neil Rabinowitz and Duncan Williams and Gabriel Barth-Maron and Ziyu Wang and Nando de Freitas and Worlds Team},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=SygKyeHKDH}
}