← Search

Sunhao Dai

11 accepted papers

2026

Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn LLM Agents

ICLR 2026poster

Large language model (LLM)–based agents are increasingly trained with reinforcement learning (RL) to enhance their ability to interact with external environments through tool use, particularly in search-based settings that require multi-turn reasoning and knowledge acquisition. However, existing app…

Cited by 0SourcecodeScholar
2026

VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics

ICML 2026oral

Existing online benchmarks for mobile GUI agents remain largely app-centric and task-homogeneous, failing to reflect the diversity and instability of real-world mobile usage. To this end, we introduce VenusBench-Mobile, a challenging online benchmark for evaluating general-purpose mobile GUI agents …

Cited by 0SourceScholar
2025

AdaO2B: Adaptive Online to Batch Conversion for Out-of-Distribution Generalization

AAAI 2025technical

Online to batch conversion involves constructing a new batch learner by utilizing a series of models generated by an existing online learning algorithm, for achieving generalization guarantees under i.i.d assumption. However, when applied to real-world streaming applications such as streaming recomm…

Cited by 0SourcePDFScholar
2025

From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactions

ICLR 2025oral

Tool learning enables Large Language Models (LLMs) to interact with external environments by invoking tools, serving as an effective strategy to mitigate the limitations inherent in their pre-training data. In this process, tool documentation plays a crucial role by providing usage instructions for…

2025

GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents

NeurIPS 2025poster

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains. In this paper, we first conduct extensive analysis experime…

Cited by 0SourcecodeScholar
2025

Length-Induced Embedding Collapse in PLM-based Models

ACL 2025long

Text embeddings from PLM-based models enable a wide range of applications, yet their performance often degrades on longer texts. In this paper, we introduce a phenomenon we call Length Collapse, where embeddings of longer texts tend to cluster together. This clustering results in a distributional in…

2025

Media Source Matters More Than Content: Unveiling Political Bias in LLM-Generated Citations

EMNLP 2025

Unlike traditional search engines that present ranked lists of webpages, generative search engines rely solely on in-line citations as the key gateway to original real-world webpages, making it crucial to examine whether LLM-generated citations have biases—particularly for politically sensitive quer

2025

Perplexity Trap: PLM-Based Retrievers Overrate Low Perplexity Documents

ICLR 2025poster

Previous studies have found that PLM-based retrieval models exhibit a preference for LLM-generated content, assigning higher relevance scores to these documents even when their semantic quality is comparable to human-written ones. This phenomenon, known as source bias, threatens the sustainable deve…

2025

Uplift-RAG: Uplift-Driven Knowledge Preference Alignment for Retrieval-Augmented Generation

EMNLP 2025

Retrieval-augmented generation (RAG) has proven effective in enhancing the knowledge coverage of large language models (LLMs) and mitigating hallucinations by incorporating external retrieved documents. However, documents deemed relevant by the retriever are not necessarily helpful for answer genera

2024

Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration

ACL 2024findings

The proliferation of Large Language Models (LLMs) has led to an influx of AI-generated content (AIGC) on the internet, transforming the corpus of Information Retrieval (IR) systems from solely human-written to a coexistence with LLM-generated content. The impact of this surge in AIGC on IR systems r…