Zechen Wu

A Unifying View of Linear Function Approximation in Off-Policy RL Through Matrix Splitting and Preconditioning

In off-policy policy evaluation (OPE) tasks within reinforcement learning, Temporal Difference Learning(TD) and Fitted Q-Iteration (FQI) have traditionally been viewed as differing in the number of updates toward the target value function: TD makes one update, FQI makes an infinite number, and Parti…