Stabilizing the Q-Gradient Field for Policy Smoothness in Actor-Critic Methods
Policies learned via continuous actor-critic methods often exhibit erratic, high-frequency oscillations, making them unsuitable for physical deployment. Current approaches attempt to enforce smoothness by directly regularizing the policy's output. We argue that this approach treats the symptom rathe…