Christian Federmann

Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies

Ten years ago a single metric, BLEU, governed progress in machine translation research. For better or worse, there is no such consensus today, and consequently it is difficult for researchers to develop and retain intuitions about metric deltas that drove earlier research and deployment decisions. T…