← Search

Kunlun Zhu

8 accepted papers

2025

MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents

ACL 2025long

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents; yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination and competition. In this paper, we introduce MultiAgentBench…

2025

RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework

ACL 2025long

Retrieval-Augmented Generation (RAG) is a powerful approach that enables large language models (LLMs) to incorporate external knowledge. However, evaluating the effectiveness of RAG systems in specialized scenarios remains challenging due to the high costs of data construction and the lack of suitab…

2025

ResearchTown: Simulator of Human Research Community

ICML 2025poster

Large Language Models (LLMs) have demonstrated remarkable potential in scientific domains, yet a fundamental question remains unanswered: Can we simulate human research communities with LLMs? Addressing this question can deepen our understanding of the processes behind idea brainstorming and inspire…

2025

SafeScientist: Enhancing AI Scientist Safety for Risk-Aware Scientific Discovery

EMNLP 2025

Recent advancements in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet concurrently raised critical ethical and safety concerns. To systematically address these challenges, we introduce **SafeScientist**, an innovative AI scientist framework expl

2025

Scaling Large Language Model-based Multi-Agent Collaboration

ICLR 2025poster

Recent breakthroughs in large language model-driven autonomous agents have revealed that multi-agent collaboration often surpasses each individual through collective reasoning. Inspired by the neural scaling law—increasing neurons enhances performance, this study explores whether the continuous addi…

2024

ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs

ICLR 2024spotlight

Despite the advancements of open-source large language models (LLMs), e.g., LLaMA, they remain significantly limited in tool-use capabilities, i.e., using external tools (APIs) to fulfill human instructions. The reason is that current instruction tuning largely focuses on basic language tasks but ig…

2023

WebCPM: Interactive Web Search for Chinese Long-form Question Answering

ACL 2023long

Long-form question answering (LFQA) aims at answering complex, open-ended questions with detailed, paragraph-length responses. The de facto paradigm of LFQA necessitates two procedures: information retrieval, which searches for relevant supporting facts, and information synthesis, which integrates t…