2026
One-shot Entropy Minimization for Language Model Reasoning
ICML 2026poster
In this work, we propose One-shot Entropy Minimization (EM), a simple and fully unsupervised post-training approach that significantly improves reasoning and generation performance using only a single unlabeled data and approximately ten gradient steps. To avoid data contamination, we pretrain a 7-b…