2025
MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
ICLR 2025oral
We introduce MLE-bench, a benchmark for measuring how well AI agents perform at machine learning engineering. To this end, we curate 75 ML engineering-related competitions from Kaggle, creating a diverse set of challenging tasks that test real-world ML engineering skills such as training models, pre…