AAAI 2026technical0 citations
CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling
Bichen Wang, Yixin Sun, Junzhe Wang, Hao Yang, Xing Fu, Yanyan Zhao, Si Wei, Shijin Wang
Abstract
The mismatch between the growing demand for psychological counseling and the limited availability of services has motivated research into the application of Large Language Models (LLMs) in this domain. Consequently, there is a need for a robust and unified benchmark to assess the counseling competence of various LLMs. Existing works, however, are limited by unprofessional client simulation, static question-and-answer evaluation formats, and unidimensional metrics. These limitations hinder their effectiveness in assessing a model
BibTeX
@inproceedings{aaai2026_carebenchabenchm,
title = {CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling},
author = {Bichen Wang and Yixin Sun and Junzhe Wang and Hao Yang and Xing Fu and Yanyan Zhao and Si Wei and Shijin Wang and Bing Qin},
booktitle = {AAAI 2026},
year = {2026}
}