← Search

Shiyi Xu

2 accepted papers

2025

ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests

NeurIPS 2025poster

With the significant progress of large reasoning models in complex coding and reasoning tasks, existing benchmarks, like LiveCodeBench and CodeElo, are insufficient to evaluate the coding capabilities of large language models (LLMs) in real competition environments. Moreover, current evaluation met…

Cited by 0SourcecodeScholar
2024

LLMBox: A Comprehensive Library for Large Language Models

ACL 2024system demonstrations

To facilitate the research on large language models (LLMs), this paper presents a comprehensive and unified library, LLMBox, to ease the development, use, and evaluation of LLMs. This library is featured with three main merits: (1) a unified data interface that supports the flexible implementation o…