2025
AlphaZero Neural Scaling and Zipf's Law: a Tale of Board Games and Power Laws
NeurIPS 2025spotlight
Neural scaling laws are observed in a range of domains, to date with no universal understanding of why they occur. Recent theories suggest that loss power laws arise from Zipf's law, a power law observed in domains like natural language. One theory suggests that language scaling laws emerge when Zip…