← Search

Simon Martin

2 accepted papers

2024

Bayes-optimal learning of an extensive-width neural network from quadratically many samples

NeurIPS 2024poster

We consider the problem of learning a target function corresponding to a single hidden layer neural network, with a quadratic activation function after the first layer, and random weights. We consider the asymptotic limit where the input dimension and the network width are proportionally large. Rece…

2024

On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions

AISTATS 2024poster

We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup. In line with previous works on the same neural architecture, the optimization is performed following the gradient flow on the population risk, where the avera…

Cited by 11SourcePDFScholar