Tomer Gafner

Discrepancy Ratio: Evaluating Model Performance When Even Experts Disagree on the Truth

In most machine learning tasks unambiguous ground truth labels can easily be acquired. However, this luxury is often not afforded to many high-stakes, real-world scenarios such as medical image interpretation, where even expert human annotators typically exhibit very high levels of disagreement with…