← Search

Xiaoshuai Song

13 accepted papers

2025

CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery

ICLR 2025poster

Large language models (LLMs) have demonstrated significant potential in advancing various fields of research and society. However, the current community of LLMs overly focuses on benchmarks for analyzing specific foundational skills (e.g. mathematics and code generation), neglecting an all-round eva…

2025

Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistants

NeurIPS 2025poster

Faces and humans are crucial elements in social interaction and are widely included in everyday photos and videos. Therefore, a deep understanding of faces and humans will enable multi-modal assistants to achieve improved response quality and broadened application scope. Currently, the multi-modal a…

Cited by 0SourcecodeScholar
2025

MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models

ICLR 2025poster

Large Language Models (LLMs) have displayed massive improvements in reason- ing and decision-making skills and can hold natural conversations with users. Recently, many tool-use benchmark datasets have been proposed. However, existing datasets have the following limitations: (1). Insufficient evalua…

2025

ProgCo: Program Helps Self-Correction of Large Language Models

ACL 2025short

Self-Correction aims to enable large language models (LLMs) to self-verify and self-refine their initial responses without external feedback. However, LLMs often fail to effectively self-verify and generate correct feedback, further misleading refinement and leading to the failure of self-correction…

2025

Toward Verifiable Instruction-Following Alignment for Retrieval Augmented Generation

AAAI 2025technical

Following natural instructions is crucial for the effective application of Retrieval-Augmented Generation (RAG) systems. Despite recent advancements in Large Language Models (LLMs), research on assessing and improving instruction-following (IF) alignment within the RAG domain remains limited. To add…

2025

We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?

ACL 2025long

Visual mathematical reasoning, as a fundamental visual reasoning ability, has received widespread attention from the Large Multimodal Models (LMMs) community. Existing benchmarks mainly focus more on the end-to-end performance, but neglect the underlying principles of knowledge acquisition and gener…

2024

Beyond the Known: Investigating LLMs Performance on Out-of-Domain Intent Detection

COLING 2024main

Out-of-domain (OOD) intent detection aims to examine whether the user’s query falls outside the predefined domain of the system, which is crucial for the proper functioning of task-oriented dialogue (TOD) systems. Previous methods address it by fine-tuning discriminative models. Recently, some studi…

Cited by 11SourcePDFScholar
2024

Faceptor: A Generalist Model for Face Perception

ECCV 2024oral

"With the comprehensive research conducted on various face analysis tasks, there is a growing interest among researchers to develop a unified approach to face perception. Existing methods mainly discuss unified representation and training, which lack task extensibility and application efficiency. To…

2024

Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-Training for Noisy Slot Filling Task

ICASSP 2024accepted

In a realistic dialogue system, the input information from users is often subject to various types of input perturbations, which affects the slot-filling task. Although rule-based data augmentation methods have achieved satisfactory results, they fail to exhibit the desired generalization when faced…

Cited by 0SourceScholar
2023

APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection

EMNLP 2023long findings

Detecting out-of-domain (OOD) intents from user queries is essential for a task-oriented dialogue system. Previous OOD detection studies generally work on the assumption that plenty of labeled IND intents exist. In this paper, we focus on a more practical few-shot OOD setting where there are only a…

Cited by 0SourceScholar
2023

Continual Generalized Intent Discovery: Marching Towards Dynamic and Open-world Intent Recognition

EMNLP 2023long findings

In a practical dialogue system, users may input out-of-domain (OOD) queries. The Generalized Intent Discovery (GID) task aims to discover OOD intents from OOD queries and extend them to the in-domain (IND) classifier. However, GID only considers one stage of OOD learning, and needs to utilize the da…

Cited by 0SourcecodeScholar
2023

Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery

ACL 2023long

Generalized intent discovery aims to extend a closed-set in-domain intent classifier to an open-world intent set including in-domain and out-of-domain intents. The key challenges lie in pseudo label disambiguation and representation learning. Previous methods suffer from a coupling of pseudo label d…

2023

Large Language Models Meet Open-World Intent Discovery and Recognition: An Evaluation of ChatGPT

EMNLP 2023long main

The tasks of out-of-domain (OOD) intent discovery and generalized intent discovery (GID) aim to extend a closed intent classifier to open-world intent sets, which is crucial to task-oriented dialogue (TOD) systems. Previous methods address them by fine-tuning discriminative models. Recently, althoug…

Cited by 0SourcecodeScholar