← Search

Shuqian Sheng

4 accepted papers

2024

Is Reference Necessary in the Evaluation of NLG Systems? When and Where?

NAACL 2024long

The majority of automatic metrics for evaluating NLG systems are reference-based. However, the challenge of collecting human annotation results in a lack of reliable references in numerous application scenarios. Despite recent advancements in reference-free metrics, it has not been well understood w…

2024

RepEval: Effective Text Evaluation with LLM Representation

EMNLP 2024main

The era of Large Language Models (LLMs) raises new demands for automatic evaluation metrics, which should be adaptable to various application scenarios while maintaining low cost and effectiveness. Traditional metrics for automatic text evaluation are often tailored to specific scenarios, while LLM-…

2023

Exploring and Verbalizing Academic Ideas by Concept Co-occurrence

ACL 2023long

Researchers usually come up with new ideas only after thoroughly comprehending vast quantities of literature. The difficulty of this procedure is exacerbated by the fact that the number of academic publications is growing exponentially. In this study, we devise a framework based on concept co-occurr…

2023

Unsupervised Graph-Text Mutual Conversion with a Unified Pretrained Language Model

ACL 2023long

Graph-to-text (G2T) generation and text-to-graph (T2G) triple extraction are two essential tasks for knowledge graphs. Existing unsupervised approaches become suitable candidates for jointly learning the two tasks due to their avoidance of using graph-text parallel data. However, they adopt multiple…

Cited by 3SourcePDFScholar