2025
Two-Timescale Critic-Actor for Average Reward MDPs with Function Approximation
AAAI 2025technical
Several recent works have focused on carrying out non-asymptotic convergence analyses for AC algorithms. Recently, a two-timescale critic-actor algorithm has been presented for the discounted cost setting in the look-up table case where the timescales of the actor and the critic are reversed and onl…