← Search

Xiaohui Song

6 accepted papers

2026

DRIFT: Difference-Aware Reinforcement Through Iterative Fine-Tuning for Language Model

AAAI 2026technical

Self-play fine-tuning has emerged as a promising approach to improve Large Language Models (LLMs) without additional human annotations. However, existing methods struggle with complex generation tasks requiring long context understanding, where models produce partially correct outputs interleaved wi

Cited by 0SourcePDFScholar
2026

PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs

ICLR 2026poster

Recently, significant progress has been made in developing reasoning-capable Large Language Models (LLMs) through long Chain-of-Thought (CoT) techniques. However, this long-CoT reasoning process imposes substantial memory overhead due to the large Key-Value (KV) Cache memory overhead. Post-training…

Cited by 0SourcecodeScholar
2025

Align Attention Heads Before Merging Them: An Effective Way for Converting MHA to GQA

EMNLP 2025

Large language models (LLMs) have demonstrated exceptional performance across diverse natural language processing tasks. However, as the model size and the input sequence’s length increase, the linearly increasing key-value (KV) cache significantly degrades inference throughput. Therefore, grouped-q

2025

BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation

COLING 2025main

In recent years, large language models (LLMs) have shown exceptional capabilities across various natural language processing (NLP) tasks. However, such impressive performance often comes with the trade-off of an increased parameter size, posing significant challenges for widespread deployment. Knowl…

2022

Emotionflow: Capture the Dialogue Level Emotion Transitions

ICASSP 2022accepted

Emotion recognition in conversations (ERC) has attracted increasing interests in recent years, due to its wide range of applications, such as customer service analysis, health-care consultation, etc. One key challenge of ERC is that users' emotions would change due to the impact of others' emotions.…

Cited by 0SourceScholar
2022

Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation

EMNLP 2022main

Capturing emotions within a conversation plays an essential role in modern dialogue systems. However, the weak correlation between emotions and semantics brings many challenges to emotion recognition in conversation (ERC). Even semantically similar utterances, the emotion may vary drastically depend…