← Search

Satinder P. Singh

6 accepted papers

2020

A Self-Tuning Actor-Critic Algorithm

NeurIPS 2020poster

Reinforcement learning algorithms are highly sensitive to the choice of hyperparameters, typically requiring significant manual effort to identify hyperparameters that perform well on a new domain. In this paper, we take a step towards addressing this issue by using metagradients to automatically ad…

2020

Discovering Reinforcement Learning Algorithms

NeurIPS 2020poster

Reinforcement learning (RL) algorithms update an agent’s parameters according to one of several possible rules, discovered manually through years of research. Automating the discovery of update rules from data could lead to more efficient algorithms, or algorithms that are better adapted to specific…

Cited by 176SourcePDFScholar
2020

Learning to Play No-Press Diplomacy with Best Response Policy Iteration

NeurIPS 2020spotlight

Recent advances in deep reinforcement learning (RL) have led to considerable progress in many 2-player zero-sum games, such as Go, Poker and Starcraft. The purely adversarial nature of such games allows for conceptually simple and principled application of RL methods. However real-world settings are…

2020

Meta-Gradient Reinforcement Learning with an Objective Discovered Online

NeurIPS 2020poster

Deep reinforcement learning includes a broad family of algorithms that parameterise an internal representation, such as a value function or policy, by a deep neural network. Each algorithm optimises its parameters with respect to an objective, such as Q-learning or policy gradient, that defines its…

Cited by 85SourcePDFScholar
2020

On Efficiency in Hierarchical Reinforcement Learning

NeurIPS 2020spotlight

Hierarchical Reinforcement Learning (HRL) approaches promise to provide more efficient solutions to sequential decision making problems, both in terms of statistical as well as computational efficiency. While this has been demonstrated empirically over time in a variety of tasks, theoretical results…

Cited by 53SourcePDFScholar
2020

The Value Equivalence Principle for Model-Based Reinforcement Learning

NeurIPS 2020poster

Learning models of the environment from data is often viewed as an essential component to building intelligent reinforcement learning (RL) agents. The common practice is to separate the learning of the model from its use, by constructing a model of the environment’s dynamics that correctly predicts…

Cited by 100SourcePDFScholar