← Search

Songzhou Yan

4 accepted papers

2024

Do Large Language Models have Problem-Solving Capability under Incomplete Information Scenarios?

ACL 2024findings

The evaluation of the problem-solving capability under incomplete information scenarios of Large Language Models (LLMs) is increasingly important, encompassing capabilities such as questioning, knowledge search, error detection, and path planning. Current research mainly focus on LLMs’ problem-solvi…

2024

Dr.Academy: A Benchmark for Evaluating Questioning Capability in Education for Large Language Models

ACL 2024long

Teachers are important to imparting knowledge and guiding learners, and the role of large language models (LLMs) as potential educators is emerging as an important area of study. Recognizing LLMs’ capability to generate educational content can lead to advances in automated and personalized learning.…

Cited by 11SourcePDFScholar
2024

EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models

ACL 2024findings

Emotional intelligence in large language models (LLMs) is of great importance in Natural Language Processing. However, the previous research mainly focus on basic sentiment analysis tasks, such as emotion recognition, which is not enough to evaluate LLMs’ overall emotional intelligence. Therefore, t…

Cited by 48SourcePDFScholar
2024

HOTVCOM: Generating Buzzworthy Comments for Videos

ACL 2024findings

In the era of social media video platforms, popular “hot-comments” play a crucial role in attracting user impressions of short-form videos, making them vital for marketing and branding purpose. However, existing research predominantly focuses on generating descriptive comments or “danmaku” in Englis…