2024
IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation
NeurIPS 2024poster
As Large Language Models (LLMs) become more capable of handling increasingly complex tasks, the evaluation set must keep pace with these advancements to ensure it remains sufficiently discriminative. Item Discrimination (ID) theory, which is widely used in educational assessment, measures the abilit…