← Search

Peixin Qin

5 accepted papers

2025

SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View

ACL 2025long

Despite the great potential of large language models (LLMs) in machine comprehension, it is still disturbing to fully count on them in real-world scenarios. This is probably because there is no rational explanation for whether the comprehension process of LLMs is aligned with that of experts. In thi…

2024

Beyond Persuasion: Towards Conversational Recommender System with Credible Explanations

EMNLP 2024finding

With the aid of large language models, current conversational recommender system (CRS) has gaining strong abilities to persuade users to accept recommended items. While these CRSs are highly persuasive, they can mislead users by incorporating incredible information in their explanations, ultimately…

2024

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models

ACL 2024long

Large language models (LLMs) are increasingly used to meet user information needs, but their effectiveness in dealing with user queries that contain various types of ambiguity remains unknown, ultimately risking user trust and satisfaction. To this end, we introduce CLAMBER, a benchmark for evaluati…

2024

Towards Equipping Transformer with the Ability of Systematic Compositionality

AAAI 2024technical

One of the key factors in language productivity and human cognition is the ability of Systematic Compositionality, which refers to understanding composed, unseen examples of seen primitives. However, recent evidence reveals that the Transformers have difficulty in generalizing the composed context b…

2023

Reduce Human Labor On Evaluating Conversational Information Retrieval System: A Human-Machine Collaboration Approach

EMNLP 2023long main

Evaluating conversational information retrieval (CIR) systems is a challenging task that requires a significant amount of human labor for annotation. It is imperative to invest significant effort into researching more labor-effective methods for evaluating CIR systems. To touch upon this challenge,…

Cited by 0SourceScholar