Kanumuri Nithin Varma

Exponential Convergence of Stochastic Mirror Descent in Over-parameterized Linear Models

Stochastic Mirror Descent (SMD) has emerged as a method for solving various convex optimization problems and, under appropriate conditions, has been shown to exponentially converge to the global optimum when the underlying loss is strongly convex. However, strong convexity of the loss fails to hold…