NeurIPS 2018poster13 citations
Distributed Multitask Reinforcement Learning with Quadratic Convergence
Rasul Tutunov, Dongho Kim, Haitham Bou Ammar
Abstract
Multitask reinforcement learning (MTRL) suffers from scalability issues when the number of tasks or trajectories grows large. The main reason behind this drawback is the reliance on centeralised solutions. Recent methods exploited the connection between MTRL and general consensus to propose scalable solutions. These methods, however, suffer from two drawbacks. First, they rely on predefined objectives, and, second, exhibit linear convergence guarantees. In this paper, we improve over state-of-the-art by deriving multitask reinforcement learning from a variational inference perspective. We then propose a novel distributed solver for MTRL with quadratic convergence guarantees.
BibTeX
@inproceedings{NEURIPS2018_8073bd4e,
author = {Tutunov, Rasul and Kim, Dongho and Bou Ammar, Haitham},
booktitle = {Advances in Neural Information Processing Systems},
editor = {S. Bengio and H. Wallach and H. Larochelle and K. Grauman and N. Cesa-Bianchi and R. Garnett},
pages = {},
publisher = {Curran Associates, Inc.},
title = {Distributed Multitask Reinforcement Learning with Quadratic Convergence},
url = {https://proceedings.neurips.cc/paper_files/paper/2018/file/8073bd4ed0fe0c330290c58056a2cd5e-Paper.pdf},
volume = {31},
year = {2018}
}