2024
Stop Regressing: Training Value Functions via Classification for Scalable Deep RL
ICML 2024oral
Value functions are an essential component in deep reinforcement learning (RL), that are typically trained via mean squared error regression to match bootstrapped target values. However, scaling value-based RL methods to large networks has proven challenging. This difficulty is in stark contrast to…