2025
Learning Rate Optimization for Deep Neural Networks Using Lipschitz Bandits
ICASSP 2025accepted
Learning rate is a crucial parameter in training of neural networks. A properly tuned learning rate leads to faster training and higher test accuracy. In this paper, we propose a Lipschitz bandit-driven approach for tuning the learning rate of neural networks. The proposed approach is compared with…