← Search

Hebi Li

4 accepted papers

2023

DocAsRef: An Empirical Study on Repurposing Reference-based Summary Quality Metrics as Reference-free Metrics

EMNLP 2023short findings

Automated summary quality assessment falls into two categories: reference-based and reference-free. Reference-based metrics, historically deemed more accurate due to the additional information provided by human-written references, are limited by their reliance on human input. In this paper, we hypot…

Cited by 0SourceScholar
2022

PrefScore: Pairwise Preference Learning for Reference-free Summarization Quality Assessment

COLING 2022main

Evaluating machine-generated summaries without a human-written reference summary has been a need for a long time. Inspired by preference labeling in existing work of summarization evaluation, we propose to judge summary quality by learning the preference rank of summaries using the Bradley-Terry pow…

2022

SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling

NAACL 2022long

Canonical automatic summary evaluation metrics, such as ROUGE, focus on lexical similarity which cannot well capture semantics nor linguistic quality and require a reference summary which is costly to obtain. Recently, there have been a growing number of efforts to alleviate either or both of the tw…