← Search

Ali Gorji

2 accepted papers

2023

A scalable Walsh-Hadamard regularizer to overcome the low-degree spectral bias of neural networks

UAI 2023poster

Despite the capacity of neural nets to learn arbitrary functions, models trained through gradient descent often exhibit a bias towards “simpler” functions. Various notions of simplicity have been introduced to characterize this behavior. Here, we focus on the case of neural networks with discrete (z…

Cited by 1SourcePDFScholar