2026
Unveiling Downstream Performance Scaling of LLMs: A Clustering-Based Perspective
ICLR 2026poster
The escalating scale and cost of Large Language Models (LLMs) training necessitate accurate pre-training prediction of downstream task performance for efficient resource allocation. This is challenged by: 1) the emergence phenomenon, where unpredictable capabilities appearing suddenly at critical mo…