Yongyuan Li — accepted AI-conference papers

2025

Evaluating Text Generation Quality Using Spectral Distances of Surprisal

Zhichen Liu, Yongyuan Li, Yang Xu, Yu Wang, Yingfang Yuan, Zuhao Yang

EMNLP 2025

We propose a novel automatic evaluation metric for open-ended text generation, which is a substantial improvement of the recently developed method, Fourier analysis of cross-entropy (FACE), hence, FACE-2. FACE-2 is a psycholinguistically inspired metric that extracts the dynamic patterns (spectrum)

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2024

Detecting Subtle Differences between Human and Model Languages Using Spectrum of Relative Likelihood

Yang Xu, Yu Wang, Hao An, Zhichen Liu, Yongyuan Li

EMNLP 2024main

Human and model-generated texts can be distinguished by examining the magnitude of likelihood in language. However, it is becoming increasingly difficult as language model’s capabilities of generating human-like texts keep evolving. This study provides a new perspective by using the relative likelih…

Cited by 3 Source ↗PDF ↗code ↗Scholar ↗