2025
Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
NeurIPS 2025poster
Dataset curation has become a basis for strong large language model (LLM) performance. While various rule-based filtering heuristics exist for English and multilingual datasets, model-based filtering techniques have primarily focused on English. To address the disparity stemming from limited researc…