Lowell Weissman

Complexity Scaling Laws for Neural Models using Combinatorial Optimization

Recent work on neural scaling laws demonstrates that model performance scales predictably with compute budget, model size, and dataset size. In this work, we develop scaling laws based on problem complexity. We analyze two fundamental complexity measures: solution space size and representation space…