← Search

Jirayu Burapacheep

4 accepted papers

2025

Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models

EMNLP 2025

Wikipedia is the largest open knowledge corpus, widely used worldwide and serving as a key resource for training large language models (LLMs) and retrieval-augmented generation (RAG) systems. Ensuring its accuracy is therefore critical. But how accurate is Wikipedia, and how can we improve it?We foc

Cited by 0SourcePDFScholar
2025

Fantastic Bugs and Where to Find Them in AI Benchmarks

NeurIPS 2025poster

Benchmarks are pivotal in driving AI progress, and invalid benchmark questions frequently undermine their reliability. Manually identifying and correcting errors among thousands of benchmark questions is not only infeasible but also a critical bottleneck for reliable evaluation. In this work, we int…

Cited by 0SourceScholar
2024

ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation

ACL 2024findings

This paper introduces the ColorSwap dataset, designed to assess and improve the proficiency of multimodal models in matching objects with their colors. The dataset is comprised of 2,000 unique image-caption pairs, grouped into 1,000 examples. Each example includes a caption-image pair, along with a…