← Search

Zhumin Chu

2 accepted papers

2026

Auto-PRE: An Automatic and Cost-Efficient Peer-Review Framework for Language Generation Evaluation

AAAI 2026technical

The rapid development of large language models (LLMs) has highlighted the need for efficient and reliable methods to evaluate their performance. Traditional evaluation methods often face challenges like high costs, limited task formats, dependence on human references, and systematic biases. To addre

Cited by 0SourcePDFScholar
2025

CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges

ACL 2025long

The use of large language models (LLMs) as automated evaluation tools to assess the quality of generated natural language, known as ”LLMs-as-Judges”, has demonstrated promising capabilities and is rapidly gaining widespread attention. However, when applied to pairwise comparisons of candidate respon…