ICML 2024poster2 citations
Hyperbolic Optimizer as a Dynamical System
Abstract
During the last few years, the field of dynamical systems has been developing innovative tools to study the asymptotic behavior of different optimizers in the context of neural networks. In this work, we redefine an extensively studied optimizer, employing classical techniques from hyperbolic geometry. This new definition is linked to a non-linear differential equation as a continuous limit. Additionally, by utilizing Lyapunov stability concepts, we analyze the asymptotic behavior of its critical points.
BibTeX
@inproceedings{
alvarado2024hyperbolic,
title={Hyperbolic Optimizer as a Dynamical System},
author={Nico Alvarado and Hans Lobel},
booktitle={Forty-first International Conference on Machine Learning},
year={2024},
url={https://openreview.net/forum?id=kZKopcDp2q}
}