Color facial expression recognition based on color local features

Abstract

In this paper, color facial expression recognition based on color local features is investigated, in which each color facial image is decomposed into three color component images. For each color component image, we extract a set of color local features to represent the color component image, where color local features could be either color local binary patterns (LBP) or color scale-invariant feature transform (SIFT). To cope with the facial expression recognition problem, we use a group sparse least square regression (GSLSR) model to describe the relationship between the color local feature vectors and the associated emotion label vectors and then perform expression recognition based on it. Finally, experiments on the Multi-PIE color facial expression database are conducted to testify the proposed method and compare the results with state-of-the-art methods.