← Search

Roy Xie

8 accepted papers

2026

When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Training

ICLR 2026poster

While Large Language Models (LLMs) hold promise to become autonomous agents, they often explore suboptimally in sequential decision-making. Recent work has sought to enhance this capability via supervised fine-tuning (SFT) or reinforcement learning (RL), improving regret on the classic multi-armed b…

Cited by 0SourcecodeScholar
2025

Improving Model Alignment Through Collective Intelligence of Open-Source Models

ICML 2025poster

Building helpful and harmless large language models (LLMs) requires effective model alignment approach based on human instructions and feedback, which necessitates high-quality human-labeled data. Constructing such datasets is often expensive and hard to scale, and may face potential limitations on…

Cited by 0SourcePDFScholar
2025

Language Models (Mostly) Know When to Stop Reading

NeurIPS 2025poster

Large language models (LLMs) process entire input contexts indiscriminately, which is inefficient when the information required to answer a query is localized within the context. We present dynamic context cutoff, a novel method enabling LLMs to self-terminate processing upon acquiring sufficient ta…

Cited by 0SourceScholar
2024

Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers

NAACL 2024short

Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects…

2024

Raccoon: Prompt Extraction Benchmark of LLM-Integrated Applications

ACL 2024findings

With the proliferation of LLM-integrated applications such as GPT-s, millions are deployed, offering valuable services through proprietary instruction prompts. These systems, however, are prone to prompt extraction attacks through meticulously designed queries. To help mitigate this problem, we intr…

2024

ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods

EMNLP 2024main

The rapid scaling of large language models (LLMs) has raised concerns about the transparency and fair use of the data used in their pretraining. Detecting such content is challenging due to the scale of the data and limited exposure of each instance during training. We propose ReCaLL (Relative Condi…

Cited by 11SourcePDFScholar
2024

Tailoring Vaccine Messaging with Common-Ground Opinions

NAACL 2024findings

One way to personalize chatbot interactions is by establishing common ground with the intended reader. A domain where establishing mutual understanding could be particularly impactful is vaccine concerns and misinformation. Vaccine interventions are forms of messaging which aim to answer concerns ex…