Hongzhi Luan

BOSE: A Systematic Evaluation Method Optimized for Base Models

This paper poses two critical issues in evaluating base models (without post-training): (1) Unstable evaluation during training: in the early stages of pre-training, the models lack the capability to answer questions as required, leading to unstable evaluation results. This instability makes it diff…