2025
Algorithm Development in Neural Networks: Insights from the Streaming Parity Task
ICML 2025oral
Even when massively overparameterized, deep neural networks show a remarkable ability to generalize. Research on this phenomenon has focused on generalization within distribution, via smooth interpolation. Yet in some settings neural networks also learn to extrapolate to data far beyond the bounds o…