Avhishek Chatterjee

Learning Rate Optimization for Deep Neural Networks Using Lipschitz Bandits

Learning rate is a crucial parameter in training of neural networks. A properly tuned learning rate leads to faster training and higher test accuracy. In this paper, we propose a Lipschitz bandit-driven approach for tuning the learning rate of neural networks. The proposed approach is compared with…