← Search

Fanjia Yan

2 accepted papers

2025

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

ICLR 2025poster

Large Language Models (LLMs) applied to code-related applications have emerged as a prominent field, attracting significant interest from academia and industry. However, as new and improved LLMs are developed, existing evaluation benchmarks (e.g., HumanEvla, MBPP) are no longer sufficient for assess…

Cited by 224SourcePDFScholar
2025

The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models

ICML 2025poster

Function calling, also called tool use, refers to an LLM's ability to invoke external functions, APIs, or user-defined tools in response to user queries—an essential capability for agentic LLM applications. Despite its prominence, there did not exist a standard benchmark to evaluate function calling…

Cited by 0SourcePDFScholar