Affect recognition from lip articulations

Rizwan Sadiq; Engin Erzin

ICASSP 2017accepted0 citations

Affect recognition from lip articulations

Abstract

Lips deliver visually active clues for speech articulation. Affective states define how humans articulate speech; hence, they also change articulation of lip motion. In this paper, we investigate effect of phonetic classes for affect recognition from lip articulations. The affect recognition problem is formalized in discrete activation, valence and dominance attributes. We use the symmetric KullbackLeibler divergence (KLD) to rate phonetic classes with larger discrimination across different affective states. We perform experimental evaluations using the IEMOCAP database. Our results demonstrate that lip articulations over a set of discriminative phonetic classes improves the affect recognition performance, and attains 3-class recognition rates for the activation, valence and dominance (AVD) attributes as 72.16%, 46.44% and 64.92%, respectively.

BibTeX

@inproceedings{icassp2017_affectrecognitio,
  title = {Affect recognition from lip articulations},
  author = {Rizwan Sadiq and Engin Erzin},
  booktitle = {ICASSP 2017},
  year = {2017}
}