2024
Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise
UAI 2024poster
Increasing the size of overparameterized neural networks has been a key in achieving state-of-the-art performance. This is captured by the double descent phenomenon, where the test loss follows a decreasing-increasing-decreasing pattern (or sometimes monotonically decreasing) as model width increase…