2020
Parabolic Approximation Line Search for DNNs
NeurIPS 2020poster
A major challenge in current optimization research for deep learning is to automatically find optimal step sizes for each update step. The optimal step size is closely related to the shape of the loss in the update step direction. However, this shape has not yet been examined in detail. This work sh…