Hirotaka Matsui

Diagnostic Uncertainty Calibration: Towards Reliable Machine Predictions in Medical Domain

We propose an evaluation framework for class probability estimates (CPEs) in the presence of label uncertainty, which is commonly observed as diagnosis disagreement between experts in the medical domain. We also formalize evaluation metrics for higher-order statistics, including inter-rater disagree…