2023
RePreM: Representation Pre-training with Masked Model for Reinforcement Learning
AAAI 2023technical
Inspired by the recent success of sequence modeling in RL and the use of masked language model for pre-training, we propose a masked model for pre-training in RL, RePreM (Representation Pre-training with Masked Model), which trains the encoder combined with transformer blocks to predict the masked…