Title
Image-based face beauty analysis via graph-based semi-supervised learning
Abstract
Automatic facial beauty analysis has become an emerging research topic. Despite some achieved advances, current methods and systems suffer from at least two limitations. Firstly, many developed systems rely on the use of ad-hoc hand-crafted features that were designed for generic pattern recognition problems. Secondly, while Deep Convolutional Neural Nets (DCNN) have been recently demonstrated to be a promising area of research in statistical machine learning, their use for automatic face beauty analysis may not guarantee optimal performances due to the use of a limited amount of face images with beauty scores. In this paper, we attempt to overcome these two main limitations by jointly exploiting two tricks. First, instead of using hand-crafted face features we use deep features of a pre-trained DCNN able to generate a high-level representation of a face image. Second, we exploit manifold learning theory and deploy three graph-based semi-supervised learning methods in order to enrich model learning without the need of additional labeled face images. These schemes perform graph-based score propagation. The proposed schemes were tested on three public datasets for beauty analysis: SCUT-FBP, M2B, and SCUT-FBP5500. These experiments, as well as many comparisons with supervised schemes, show that the scheme coined Kernel Flexible Manifold Embedding compares favorably with many supervised schemes. They also show that its performances in terms of error prediction and Pearson Correlation are better than those reported for the used datasets.
Year
DOI
Venue
2020
10.1007/s11042-019-08206-8
Multimedia Tools and Applications
Keywords
Field
DocType
Image-based face beauty analysis, Semi-supervised learning, Graph-based label propagation, Deep face features
Kernel (linear algebra),Graph,Pearson product-moment correlation coefficient,Semi-supervised learning,Pattern recognition,Computer science,Beauty,Exploit,Artificial intelligence,Artificial neural network,Nonlinear dimensionality reduction
Journal
Volume
Issue
ISSN
79
3-4
1573-7721
Citations 
PageRank 
References 
2
0.40
0
Authors
4
Name
Order
Citations
PageRank
Fadi Dornaika180996.43
A. Elorza220.40
K. Wang320.40
Ignacio Arganda-Carreras4718.02