← Search

Benfeng Xu

15 accepted papers

2026

DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents

ICLR 2026poster

Deep Research Agents (DRAs) are emerging as one of the most practical classes of LLM-based agents. Given an open-ended research task, they find, analyze, and synthesize large numbers of online sources to produce a comprehensive report at the level of a research analyst. This can compress hours of ma…

Cited by 0SourcecodeScholar
2026

MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Tools

AAAI 2026technical

The Model Context Protocol (MCP) is rapidly emerging as a pivotal open standard, designed to enhance agent-tool integration and interoperability, and is positioned to unlock a new era of powerful, interconnected, and genuinely utilitarian agentic AI. However, despite MCP

Cited by 0SourcePDFScholar
2025

Automated Creativity Evaluation for Large Language Models: A Reference-Based Approach

EMNLP 2025

Creative writing is a key capability of Large Language Models (LLMs), with potential applications in literature, storytelling, and various creative domains. However, evaluating the creativity of machine-generated texts remains a significant challenge, as existing methods either rely on costly manual

Cited by 0SourcePDFScholar
2025

From Real to Synthetic: Synthesizing Millions of Diversified and Complicated User Instructions with Attributed Grounding

ACL 2025long

The pursuit of diverse, complex, and large-scale instruction data is crucial for automatically aligning large language models (LLMs). While there are methods capable of generating synthetic instructions at scale, they either suffer from limited grounding sources, leading to a narrow distribution, or…

2025

MIRROR: Multi-agent Intra- and Inter-Reflection for Optimized Reasoning in Tool Learning

IJCAI 2025

Complex tasks involving tool integration pose significant challenges for Large Language Models (LLMs), leading to the emergence of multi-agent workflows as a promising solution. Reflection has emerged as an effective strategy for correcting erroneous trajectories in agentic workflows. However, exist

Cited by 0SourcePDFScholar
2025

Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability

ACL 2025finding

Training language models with rationales augmentation has been shown to be beneficial in many existing works. In this paper, we identify that such a prevailing view does not hold consistently. We conduct comprehensive investigations to thoroughly inspect the impact of rationales on model performance…

2024

Disentangled Learning with Synthetic Parallel Data for Text Style Transfer

ACL 2024long

Text style transfer (TST) is an important task in natural language generation, which aims to transfer the text style (e.g., sentiment) while keeping its semantic information. Due to the absence of parallel datasets for supervision, most existing studies have been conducted in an unsupervised manner,…

2024

KNN-Instruct: Automatic Instruction Construction with K Nearest Neighbor Deduction

EMNLP 2024main

Supervised fine-tuning (SFT) is a critical procedure for aligning large language models. Despite its efficiency, the construction of SFT data often struggles with issues of quality, diversity, and scalability. Many existing methods, inspired by the Self-Instruct framework, typically generate synthet…

2023

$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference

ICLR 2023poster

In-Context Learning (ICL), which formulates target tasks as prompt completion conditioned on in-context demonstrations, has become the prevailing utilization of LLMs. In this paper, we first disclose an actual predicament for this typical usage that it can not scale up with training data due to cont…

2023

Modaldrop: Modality-Aware Regularization for Temporal-Spectral Fusion in Human Activity Recognition

ICASSP 2023accepted

Although most of existing works for sensor-based Human Activity Recognition rely on the temporal view, we argue that the spectral view also provides complementary prior and accordingly benchmark a standard multi-view framework with extensive experiments to demonstrate its consistent superiority over…

Cited by 0SourceScholar
2023

On the Calibration of Large Language Models and Alignment

EMNLP 2023long findings

As large language models attract increasing attention and find widespread application, concurrent challenges of reliability also arise at the same time. Confidence calibration, an effective analysis method for gauging the reliability of deep models, serves as a crucial tool for assessing and improvi…

Cited by 0SourceScholar
2023

S2ynRE: Two-stage Self-training with Synthetic data for Low-resource Relation Extraction

ACL 2023long

Current relation extraction methods suffer from the inadequacy of large-scale annotated data. While distant supervision alleviates the problem of data quantities, there still exists domain disparity in data qualities due to its reliance on domain-restrained knowledge bases. In this work, we propose…

2022

EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction

NAACL 2022long

Multi-triple extraction is a challenging task due to the existence of informative inter-triple correlations, and consequently rich interactions across the constituent entities and relations. While existing works only explore entity representations, we propose to explicitly introduce relation represe…

2022

UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction

EMNLP 2022main

Relational triple extraction is challenging for its difficulty in capturing rich correlations between entities and relations. Existing works suffer from 1) heterogeneous representations of entities and relations, and 2) heterogeneous modeling of entity-entity interactions and entity-relation interac…

2021

Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction

AAAI 2021technical

Entities, as the essential elements in relation extraction tasks, exhibit certain structure. In this work, we formulate such entity structure as distinctive dependencies between mention pairs. We then propose SSAN, which incorporates these structural dependencies within the standard self-attention m…