← Search

Qinlin Zhao

4 accepted papers

2025

Exploring the Choice Behavior of Large Language Models

ACL 2025finding

Large Language Models (LLMs) are increasingly deployed as human assistants across various domains where they help to make choices. However, the mechanisms behind LLMs’ choice behavior remain unclear, posing risks in safety-critical situations. Inspired by the intrinsic and extrinsic motivation frame…

Cited by 0SourcePDFScholar
2024

AgentReview: Exploring Peer Review Dynamics with LLM Agents

EMNLP 2024main

Peer review is fundamental to the integrity and advancement of scientific publication. Traditional methods of peer review analyses often rely on exploration and statistics of existing peer review data, which do not adequately address the multivariate nature of the process, account for the latent var…

2024

CompeteAI: Understanding the Competition Dynamics of Large Language Model-based Agents

ICML 2024oral

Large language models (LLMs) have been widely used as agents to complete different tasks, such as personal assistance or event planning. Although most of the work has focused on cooperation and collaboration between agents, little work explores *competition*, another important mechanism that promote…

2024

Dynamic Evaluation of Large Language Models by Meta Probing Agents

ICML 2024poster

Evaluation of large language models (LLMs) has raised great concerns in the community due to the issue of data contamination. Existing work designed evaluation protocols using well-defined algorithms for specific tasks, which cannot be easily extended to diverse scenarios. Moreover, current evaluati…