Colten DiIanni

Don’t Sweat the Small Stuff: Segment-Level Meta-Evaluation Based on Pairwise Difference Correlation

This paper introduces Pairwise Difference Pearson (PDP), a novel segment-level meta-evaluation metric for Machine Translation (MT) that addresses limitations in previous Pearson’s 𝜌 -based and Kendall’s 𝜏 -based meta-evaluation approaches. PDP is a correlation-based metric that utilizes pairwise dif