2026
A Risk Decomposition Framework for Pre-hoc Fine-tuning Prediction
ICML 2026poster
The high cost of fine-tuning LLMs poses a significant economic barrier; pre-hoc performance prediction offers a critical solution to substantially reduce this expense. However, the theoretical limits of pre-hoc performance prediction remain unexplored. We formulate it as a stochastic estimation prob…