Yaxiong Yuan

ProxSGD: Training Structured Neural Networks under Regularization and Constraints

In this paper, we consider the problem of training neural networks (NN). To promote a NN with specific structures, we explicitly take into consideration the nonsmooth regularization (such as L1-norm) and constraints (such as interval constraint). This is formulated as a constrained nonsmooth nonconv…