2025
Extending Whisper for Emotion Prediction Using Word-level Pseudo Labels
ICASSP 2025accepted
This paper extends Whisper’s automatic speech recognition (ASR) capabilities to perform speech-based emotion recognition (SER) by incorporating word-level emotion classification alongside ASR output. We generate four emotion pseudo-labels (neutral, happy, sad, angry) for each word using a pretrained…