2024
Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning
ICML 2024poster
Second-order information is valuable for many applications but challenging to compute. Several works focus on computing or approximating Hessian diagonals, but even this simplification introduces significant additional costs compared to computing a gradient. In the absence of efficient exact computa…