2024
A New Neural Kernel Regime: The Inductive Bias of Multi-Task Learning
NeurIPS 2024poster
This paper studies the properties of solutions to multi-task shallow ReLU neural network learning problems, wherein the network is trained to fit a dataset with minimal sum of squared weights. Remarkably, the solutions learned for each individual task resemble those obtained by solving a kernel regr…