2015
On TD(0) with function approximation: Concentration bounds and a centered variant with exponential convergence
ICML 2015poster
We provide non-asymptotic bounds for the well-known temporal difference learning algorithm TD(0) with linear function approximators. These include high-probability bounds as well as bounds in expectation. Our analysis suggests that a step-size inversely proportional to the number of iterations canno…