2026
Revisiting Zeroth-Order Hessian Approximation: A Single-Step Policy Optimization Lens
ICML 2026poster
Accurate Zeroth-Order (ZO) Hessian estimation is a cornerstone of derivative-free methods, essential for tasks such as bilevel optimization, Bayesian inference, and uncertainty quantification. However, obtaining a complete suite of low-variance estimators for the Hessian and its inverse in high-dime…