Minghan Fu

QLABGrad: A Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning

The learning rate is a critical hyperparameter for deep learning tasks since it determines the extent to which the model parameters are adjusted during the learning course. However, the choice of learning rates typically depends on empirical judgment, which may not result in satisfactory outcomes wi…