Decoding emotional experiences through physiological signal processing

Abstract

All modern emotion theoretical views assume a role for peripheral physiological changes during emotional experiences. In this paper, we explored the correlation between autonomically-mediated changes in multimodal bodily signals and discrete emotional states. In order to fully exploit the information in each modality, week learners based on individual signal modalities are built and then fused to formed a robust inference model. To validate our model, three specific physiological signals including Electromyogram (EMG), Blood Volume Pressure (BVP) and Galvanic Skin Response (GSR) recorded during eight emotional states were analyzed. Our approach showed 88.1% emotion recognition accuracy, which outperformed the conventional Support Vector Machine (SVM) classifier with 17% accuracy improvement. Furthermore, in order to avoid information redundancy and the resultant over-fitting, a feature reduction method is proposed based on a correlation analysis to optimize the number of features required for training and validating each weak learner. Despite the feature space dimensionality reduction from 27 to 18 features, our methodology preserved the recognition accuracy of about 85.0%.