← Search

Lan Liu

7 accepted papers

2026

SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment

ICASSP 2026poster

Singing voice generation progresses rapidly, yet evaluating singing quality remains a critical challenge. Human subjective assessment, typically in the form of listening tests, is costly and time consuming, while existing objective metrics capture only limited perceptual aspects. In this work, we in…

Cited by 0SourcePDFScholar
2025

CiteEval: Principle-Driven Citation Evaluation for Source Attribution

ACL 2025long

Citation quality is crucial in information-seeking systems, directly influencing trust and the effectiveness of information access. Current evaluation frameworks, both human and automatic, mainly rely on Natural Language Inference (NLI) to assess binary or ternary supportiveness from cited sources,…

Cited by 0SourcePDFScholar
2024

RAG-QA Arena: Evaluating Domain Robustness for Long-form Retrieval Augmented Question Answering

EMNLP 2024main

Question answering based on retrieval augmented generation (RAG-QA) is an important research topic in NLP and has a wide range of real-world applications. However, most existing datasets for this task are either constructed using a single source corpus or consist of short extractive answers, which f…

2023

Hybrid Hierarchical Retrieval for Open-Domain Question Answering

ACL 2023findings

Retrieval accuracy is crucial to the performance of open-domain question answering (ODQA) systems. Recent work has demonstrated that dense hierarchical retrieval (DHR), which retrieves document candidates first and then relevant passages from the refined document set, can significantly outperform th…

2023

Improving Cross-task Generalization of Unified Table-to-text Models with Compositional Task Configurations

ACL 2023findings

There has been great progress in unifying various table-to-text tasks using a single encoder-decoder model trained via multi-task learning (Xie et al., 2022).However, existing methods typically encode task information with a simple dataset name as a prefix to the encoder. This not only limits the ef…

Cited by 2SourcePDFScholar
2023

RobustQA: Benchmarking the Robustness of Domain Adaptation for Open-Domain Question Answering

ACL 2023findings

Open-domain question answering (ODQA) is a crucial task in natural language processing. A typical ODQA system relies on a retriever module to select relevant contexts from a large corpus for a downstream reading comprehension model. Existing ODQA datasets consist mainly of Wikipedia corpus, and are…

2023

Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks

EMNLP 2023short findings

Generative models have been widely applied to solve extractive tasks, where parts of the input is extracted to form the desired output, and achieved significant success. For example, in extractive question answering (QA), generative models have constantly yielded state-of-the-art results. In this wo…

Cited by 0SourcecodeScholar