Flip Korn

Forest vs Tree: The (N, K) Trade-off in Reproducible ML Evaluation

Reproducibility is a cornerstone of scientific validation and of the authority it confers on its results. Reproducibility in machine learning evaluations leads to greater trust, confidence, and value. However, the ground truth responses used in machine learning often necessarily come from humans, am