← Search

Zhi-Yuan Chen

3 accepted papers

2025

Beyond the Surface: Measuring Self-Preference in LLM Judgments

EMNLP 2025

Recent studies show that large language models (LLMs) exhibit self-preference bias when serving as judges, meaning they tend to favor their own responses over those generated by other models. Existing methods typically measure this bias by calculating the difference between the scores a judge model

2024

Large Language Model-based Human-Agent Collaboration for Complex Task Solving

EMNLP 2024finding

In recent developments within the research community, the integration of Large Language Models (LLMs) in creating fully autonomous agents has garnered significant interest. Despite this, LLM-based agents frequently demonstrate notable shortcomings in adjusting to dynamic environments and fully grasp…

2024

Towards Tool Use Alignment of Large Language Models

EMNLP 2024main

Recently, tool use with LLMs has become one of the primary research topics as it can help LLM generate truthful and helpful responses. Existing studies on tool use with LLMs primarily focus on enhancing the tool-calling ability of LLMs. In practice, like chat assistants, LLMs are also required to al…