← Search

Zishu Qin

2 accepted papers

2025

Instance-level Randomization: Toward More Stable LLM Evaluations

EMNLP 2025

Evaluations of large language models (LLMs) suffer from instability, where small changes of random factors such as few-shot examples can lead to drastic fluctuations of scores and even model rankings. Moreover, different LLMs can have different preferences for a certain setting of random factors. As