Enhanced Multimodal Depression Detection With Emotion Prompts
Shiyu Teng, Jiaqing Liu, Hao Sun, Shurong Chai, Tomoko Tateyama, Lanfen Lin, Yen-Wei Chen
Abstract
Depression is a pervasive mental health disorder that remains frequently undiagnosed and untreated due to societal barriers and the subjective nature of its symptoms. Leveraging recent advances in large language models (LLMs), we propose a novel depression detection pipeline that generates emotion prompts tailored to individual data, enhancing detection accuracy. Our approach integrates cross-modality fusion via cross attention mechanisms to combine depressive and emotional features, creating a comprehensive representation of depression indicators. Evaluated on the E-DAIC and EATD datasets, our method outperforms state-of-the-art techniques, demonstrating its potential for more precise emotion-based depression detection.
BibTeX
@inproceedings{icassp2025_enhancedmultimod,
title = {Enhanced Multimodal Depression Detection With Emotion Prompts},
author = {Shiyu Teng and Jiaqing Liu and Hao Sun and Shurong Chai and Tomoko Tateyama and Lanfen Lin and Yen-Wei Chen},
booktitle = {ICASSP 2025},
year = {2025}
}