2023
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist
ACL 2023long
In this study, we analyze automatic evaluation metrics for Natural Language Generation (NLG), specifically task-agnostic metrics and human-aligned metrics. Task-agnostic metrics, such as Perplexity, BLEU, BERTScore, are cost-effective and highly adaptable to diverse NLG tasks, yet they have a weak c…