Facial attractiveness prediction using psychologically inspired convolutional neural network (PI-CNN)

Jie Xu; Lianwen Jin; Lingyu Liang; Ziyong Feng; Duorui Xie; Huiyun Mao

ICASSP 2017accepted0 citations

Facial attractiveness prediction using psychologically inspired convolutional neural network (PI-CNN)

Jie Xu, Lianwen Jin, Lingyu Liang, Ziyong Feng, Duorui Xie, Huiyun Mao

Abstract

This paper proposes a psychologically inspired convolutional neural network (PI-CNN) to achieve automatic facial beauty prediction. Different from the previous methods, the PI-CNN is a hierarchical model that facilitates both the facial beauty representation learning and predictor training. Inspired by the recent psychological studies, significant appearance features of facial detail, lighting and color were used to optimize the PI-CNN facial beauty predictor using a new cascaded fine-tuning method. Experiments indicate that the cascaded fine-tuned PI-CNN predictor is robust to facial appearance variances, and obtains the highest correlation of 0.87 in the SCUT-FBP benchmark database, which is superior to the related hand-designed feature and related deep learning methods.

BibTeX

@inproceedings{icassp2017_facialattractive,
  title = {Facial attractiveness prediction using psychologically inspired convolutional neural network (PI-CNN)},
  author = {Jie Xu and Lianwen Jin and Lingyu Liang and Ziyong Feng and Duorui Xie and Huiyun Mao},
  booktitle = {ICASSP 2017},
  year = {2017}
}