2022
Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information
ICLR 2022poster
We present a novel adaptive optimization algorithm for large-scale machine learning problems. Equipped with a low-cost estimate of local curvature and Lipschitz smoothness, our method dynamically adapts the search direction and step-size. The search direction contains gradient information preconditi…