Praveen Raj Veluswami

Optimizing Neural Network Training and Quantization with Rooted Logistic Objectives

First-order methods are widely employed for training neural networks that are used in practical applications. For classification of input features, Cross-Entropy based loss functions are often preferred since they are differentiable everywhere. Recent optimization results show that the convergence p…