← Search

Guangxiang Zhu

6 accepted papers

2021

Generalizable Episodic Memory for Deep Reinforcement Learning

ICML 2021spotlight

Episodic memory-based methods can rapidly latch onto past successful strategies by a non-parametric memory and improve sample efficiency of traditional reinforcement learning. However, little effort is put into the continuous domain, where a state is never visited twice, and previous episodic method…

2021

Model-Based Reinforcement Learning via Imagination with Derived Memory

NeurIPS 2021poster

Model-based reinforcement learning aims to improve the sample efficiency of policy learning by modeling the dynamics of the environment. Recently, the latent dynamics model is further developed to enable fast planning in a compact space. It summarizes the high-dimensional experiences of an agent, wh…

Cited by 9SourcePDFScholar
2021

Offline Reinforcement Learning with Reverse Model-based Imagination

NeurIPS 2021poster

In offline reinforcement learning (offline RL), one of the main challenges is to deal with the distributional shift between the learning policy and the given dataset. To address this problem, recent offline RL methods attempt to introduce conservatism bias to encourage learning in high-confidence a…

Cited by 71SourcePDFScholar
2021

On the Estimation Bias in Double Q-Learning

NeurIPS 2021poster

Double Q-learning is a classical method for reducing overestimation bias, which is caused by taking maximum estimated values in the Bellman operation. Its variants in the deep Q-learning paradigm have shown great promise in producing reliable value prediction and improving learning performance. Howe…

2020

Bridging Imagination and Reality for Model-Based Deep Reinforcement Learning

NeurIPS 2020poster

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary trajectories with a learned world model. However, world model learning may suffer from…