← Search

Mingzhou Xu

4 accepted papers

2024

Revisiting the Self-Consistency Challenges in Multi-Choice Question Formats for Large Language Model Evaluation

COLING 2024main

Multi-choice questions (MCQ) are a common method for assessing the world knowledge of large language models (LLMs), demonstrated by benchmarks such as MMLU and C-Eval. However, recent findings indicate that even top-tier LLMs, such as ChatGPT and GPT4, might display inconsistencies when faced with s…

Cited by 8SourcePDFScholar
2023

A Survey on Zero Pronoun Translation

ACL 2023long

Zero pronouns (ZPs) are frequently omitted in pro-drop languages (e.g. Chinese, Hungarian, and Hindi), but should be recalled in non-pro-drop languages (e.g. English). This phenomenon has been studied extensively in machine translation (MT), as it poses a significant challenge for MT systems due to…

2022

GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation

EMNLP 2022main

The phenomenon of zero pronoun (ZP) has attracted increasing interest in the machine translation (MT) community due to its importance and difficulty. However, previous studies generally evaluate the quality of translating ZPs with BLEU scores on MT testsets, which is not expressive or sensitive enou…