← Search

Amy Xin

3 accepted papers

2025

AGENTIF: Benchmarking Large Language Models Instruction Following Ability in Agentic Scenarios

NeurIPS 2025spotlight

Large Language Models (LLMs) have demonstrated advanced capabilities in real-world agentic applications. Growing research efforts aim to develop LLM-based agents to address practical demands, introducing a new challenge: agentic scenarios often involve lengthy instructions with complex constraints,…

Cited by 0SourcecodeScholar
2025

How do Transformers Learn Implicit Reasoning?

NeurIPS 2025spotlight

Recent work suggests that large language models (LLMs) can perform multi-hop reasoning implicitly---producing correct answers without explicitly verbalizing intermediate steps---but the underlying mechanisms remain poorly understood. In this paper, we study how such implicit reasoning emerges by tra…

Cited by 0SourceScholar
2024

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

ICLR 2024poster

The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations. Rather than merely exploring the breadth of LLM abilities, we believe meticulous and thoughtful designs are essential to thorough, unbiased, and applicable evaluations. Given the importance of wor…