2025
Position: Enough of Scaling LLMs! Lets Focus on Downscaling
ICML 2025poster
We challenge the dominant focus on neural scaling laws and advocate for a paradigm shift toward downscaling in the development of large language models (LLMs). While scaling laws have provided critical insights into performance improvements through increasing model and dataset size, we emphasize the…