Petr Šimánek

Investigation into Training Dynamics of Learned Optimizers (Student Abstract)

Modern machine learning heavily relies on optimization, and as deep learning models grow more complex and data-hungry, the search for efficient learning becomes crucial. Learned optimizers disrupt traditional handcrafted methods such as SGD and Adam by learning the optimization strategy itself, pote…