CompleteP for RL: Maintaining Feature Learning When Scaling Deep Reinforcement Learning
The maximal update parameterization ($\mu P$) has been influential in supervised and unsupervised learning conditions, with fixed data distributions, owing to its ability to maintain feature learning across larger parameter scales. This parameterization facilitates more consistent learning dynamics …