Adam Byerly — accepted AI-conference papers

2025

TurkingBench: A Challenge Benchmark for Web Agents

Kevin Xu, Yeganeh Kordi, Tanay Nayak, Adi Asija, Yizhong Wang, Kate Sanders +4

NAACL 2025long

Can advanced multi-modal models effectively tackle complex web-based tasks? Such tasks are often found on crowdsourcing platforms, where crowdworkers engage in challenging micro-tasks within web-based environments.Building on this idea, we present TurkingBench, a benchmark consisting of tasks presen…

Cited by 7 Source ↗PDF ↗code ↗Scholar ↗

2024

Insights into LLM Long-Context Failures: When Transformers Know but Don’t Tell

Muhan Gao, TaiMing Lu, Kuai Yu, Adam Byerly, Daniel Khashabi

EMNLP 2024finding

Large Language Models (LLMs) exhibit positional bias, struggling to utilize information from the middle or end of long contexts. Our study explores LLMs’ long-context reasoning by probing their hidden representations. We find that while LLMs encode the position of target information, they often fail…

Cited by 7 Source ↗PDF ↗code ↗Scholar ↗