AAAI 2026technical0 citations
ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions
Xingwei He, Qianru Zhang, Pengfei Chen, Guanhua Chen, Linlin Yu, Yuan Yuan, Siu-Ming Yiu
Abstract
Instruction-following is a critical capability of Large Language Models (LLMs). While existing works primarily focus on assessing how well LLMs adhere to user instructions, they often overlook scenarios where instructions contain conflicting constraints—a common occurrence in complex prompts. The behavior of LLMs under such conditions remains under-explored. To bridge this gap, we introduce ConInstruct, a benchmark specifically designed to assess LLMs
BibTeX
@inproceedings{aaai2026_coninstructevalu,
title = {ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions},
author = {Xingwei He and Qianru Zhang and Pengfei Chen and Guanhua Chen and Linlin Yu and Yuan Yuan and Siu-Ming Yiu},
booktitle = {AAAI 2026},
year = {2026}
}