Chi-kiu Lo

Data Sampling and (In)stability in Machine Translation Evaluation

We analyze the different data sampling approaches used in selecting data for human evaluation and ranking of machine translation systems at the highly influential Conference on Machine Translation (WMT). By using automatic evaluation metrics, we are able to focus on the impact of the data sampling p…