2026
A Sketch-and-Project Analysis of Subsampled Natural Gradient Algorithms
ICML 2026poster
Subsampled natural gradient descent (SNG) has been used to enable high-precision scientific machine learning, but standard analyses based on stochastic preconditioning fail to provide insight into realistic small-sample settings. We overcome this limitation by instead analyzing SNG as a sketch-and-p…