2025
Position: AI Should Not Be An Imitation Game: Centaur Evaluations
ICML 2025poster
Benchmarks and evaluations are central to machine learning methodology and direct research in the field. Current evaluations commonly test systems in the absence of humans. This position paper argues that the machine learning community should increasingly use _centaur evaluations_, in which humans a…