← Search

Eric Liang

6 accepted papers

2021

RLlib Flow: Distributed Reinforcement Learning is a Dataflow Problem

NeurIPS 2021poster

Researchers and practitioners in the field of reinforcement learning (RL) frequently leverage parallel computation, which has led to a plethora of new algorithms and systems in the last few years. In this paper, we re-examine the challenges posed by distributed RL and try to view it through the lens…

2020

IMPACT: Importance Weighted Asynchronous Architectures with Clipped Target Networks

ICLR 2020poster

The practical usage of reinforcement learning agents is often bottlenecked by the duration of training time. To accelerate training, practitioners often turn to distributed reinforcement learning architectures to parallelize and accelerate the training process. However, modern methods for scalable r…

Cited by 14SourceScholar
2020

Variable Skipping for Autoregressive Range Density Estimation

ICML 2020poster

Deep autoregressive models compute point likelihood estimates of individual data points. However, many applications (i.e., database cardinality estimation), require estimating range densities, a capability that is under-explored by current neural density estimation literature. In these applications,…

2019

Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules

ICML 2019oral

A key challenge in leveraging data augmentation for neural network training is choosing an effective augmentation policy from a large search space of candidate operations. Properly chosen augmentation policies can lead to significant generalization improvements; however, state-of-the-art approaches…

2018

Benchmarks for reinforcement learning in mixed-autonomy traffic

CoRL 2018

We release new benchmarks in the use of deep reinforcement learning (RL) to create controllers for mixed-autonomy traffic, where connected and autonomous vehicles (CAVs) interact with human drivers and infrastructure. Benchmarks, such as Mujoco or the Arcade Learning Environment, have spurred new re

2018

RLlib: Abstractions for Distributed Reinforcement Learning

ICML 2018oral

Reinforcement learning (RL) algorithms involve the deep nesting of highly irregular computation patterns, each of which typically exhibits opportunities for distributed computation. We argue for distributing RL components in a composable way by adapting algorithms for top-down hierarchical control,…