← Search

Joshua Romoff

9 accepted papers

2024

Improving Intrinsic Exploration by Creating Stationary Objectives

ICLR 2024poster

Exploration bonuses in reinforcement learning guide long-horizon exploration by defining custom intrinsic objectives. Count-based methods use the frequency of state visits to derive an exploration bonus. In this paper, we identify that any intrinsic reward function derived from count-based methods i…

Cited by 3SourcePDFScholar
2022

Direct Behavior Specification via Constrained Reinforcement Learning

ICML 2022spotlight

The standard formulation of Reinforcement Learning lacks a practical way of specifying what are admissible and forbidden behaviors. Most often, practitioners go about the task of behavior specification by manually engineering the reward function, a counter-intuitive process that requires several ite…

2021

Deep Reinforcement Learning for Navigation in AAA Video Games

IJCAI 2021poster

In video games, \non-player characters (NPCs) are used to enhance the players' experience in a variety of ways, e.g., as enemies, allies, or innocent bystanders. A crucial component of NPCs is navigation, which allows them to move from one point to another on the map. The most popular approach for N…

Cited by 55SourcePDFScholar
2019

Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning

NeurIPS 2019poster

Multi-simulator training has contributed to the recent success of Deep Reinforcement Learning (Deep RL) by stabilizing learning and allowing for higher training throughputs. In this work, we propose Gossip-based Actor-Learner Architectures (GALA) where several actor-learners (such as A2C agents) are…

2019

Randomized Value Functions via Multiplicative Normalizing Flows

UAI 2019poster

Randomized value functions offer a promising approach towards the challenge of efficient exploration in complex environments with high dimensional state and action spaces. Unlike traditional point estimate methods, randomized value functions maintain a posterior distribution over action-space values…

Cited by 47SourcePDFScholar
2019

Separating value functions across time-scales

ICML 2019oral

In many finite horizon episodic reinforcement learning (RL) settings, it is desirable to optimize for the undiscounted return - in settings like Atari, for instance, the goal is to collect the most points while staying alive in the long run. Yet, it may be difficult (or even intractable) mathematica…

2018

Reward Estimation for Variance Reduction in Deep Reinforcement Learning

CoRL 2018

Reinforcement Learning (RL) agents require the specification of a reward signal for learning behaviours. However, introduction of corrupt or stochastic rewards can yield high variance in learning. Such corruption may be a direct result of goal misspecification, randomness in the reward signal, or co

2017

Hybrid Reward Architecture for Reinforcement Learning

NeurIPS 2017poster

One of the main challenges in reinforcement learning (RL) is generalisation. In typical deep RL methods this is achieved by approximating the optimal value function with a low-dimensional representation using a deep network. While this approach works well in many domains, in domains where the optim…

Cited by 331SourcePDFScholar