Bastien Dubail

Shift Before You Learn: Enabling Low-Rank Representations in Reinforcement Learning

Low-rank structure is a common implicit assumption in many modern reinforcement learning (RL) algorithms. For instance, reward-free and goal-conditioned RL methods often presume that the successor measure admits a low-rank representation. In this work, we challenge this assumption by first remarking…