2025
BOSE: A Systematic Evaluation Method Optimized for Base Models
ACL 2025finding
This paper poses two critical issues in evaluating base models (without post-training): (1) Unstable evaluation during training: in the early stages of pre-training, the models lack the capability to answer questions as required, leading to unstable evaluation results. This instability makes it diff…