2023
Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
ICML 2023poster
Riemannian submanifold optimization with momentum is computationally challenging because, to ensure that the iterates remain on the submanifold, we often need to solve difficult differential equations. Here, we simplify such difficulties for a class of structured symmetric positive-definite matrices…