2025
Theoretical Limitations of Ensembles in the Age of Overparameterization
ICML 2025oral
Classic ensembles generalize better than any single component model. In contrast, recent empirical studies find that modern ensembles of (overparameterized) neural networks may not provide any inherent generalization advantage over single but larger neural networks. This paper clarifies how modern o…