Shayan Aziznejad

Deep Spline Networks with Control of Lipschitz Regularity

The motivation for this work is to improve the performance of deep neural networks through the optimization of the individual activation functions. Since the latter results in an infinite- dimensional optimization problem, we resolve the ambiguity by searching for the sparsest and most regular solut…