Golden Ratio: The Attributes of Facial Attractiveness Learned By CNN

The recent success of deep learning has promoted the applications in facial attractiveness prediction and enhancement. However, what attributes have been learned to represent facial attractiveness is not well discovered yet. In this work, we find that DNN can learn both local and global shape-cues of face (Golden Ratio) that associate with facial attractiveness. This finding is concluded from a newly trained CNN model and an interpretation of visualizing activation of the category-specific neurons. The CNN model is trained on thousands extremely attractive/unattractive face images, and achieves an accuracy of 98.05%. The deconvolutional neural network generates face-like representations that depict the intuitive attributes of four face attractive categories. The results are consistent with the beauty ratios of facial attractiveness in psychological research.

[1]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[2]  Shuicheng Yan,et al.  Deep Face Beautification , 2015, ACM Multimedia.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  M. Livio The Golden Ratio: The Story of Phi, the World's Most Astonishing Number , 2002 .

[5]  Hod Lipson,et al.  Understanding Neural Networks Through Deep Visualization , 2015, ArXiv.

[6]  Xinlei Chen,et al.  Visualizing and Understanding Neural Models in NLP , 2015, NAACL.

[7]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[8]  Ashok Samal,et al.  Computation of a face attractiveness index based on neoclassical canons, symmetry, and golden ratios , 2008, Pattern Recognit..

[9]  LinLin Shen,et al.  A review on Gabor wavelets for face recognition , 2006, Pattern Analysis and Applications.

[10]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[11]  Anne Marie Kuijpers-Jagtman,et al.  Putative golden proportions as predictors of facial esthetics in adolescents. , 2008, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[12]  Luc Van Gool,et al.  Some Like It Hot — Visual Guidance for Preference Prediction , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Y. Jefferson Facial beauty--establishing a universal standard. , 2004, International journal of orthodontics.

[14]  Ming Shao,et al.  Attractive or Not?: Beauty Prediction with Attractiveness-Aware Encoders and Robust Late Fusion , 2014, ACM Multimedia.

[15]  Jason Yosinski,et al.  Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks , 2016, ArXiv.

[16]  Lukas Prantl,et al.  Attractiveness of Eyebrow Position and Shape in Females Depends on the Age of the Beholder , 2007, Aesthetic Plastic Surgery.

[17]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, SIGGRAPH 2008.

[18]  J. Langlois,et al.  Infant preferences for attractive faces: a cognitive explanation. , 1999, Developmental psychology.

[19]  Pamela M. Pallett,et al.  New “golden” ratios for facial beauty , 2010, Vision Research.

[20]  Luc Van Gool,et al.  Face Detection without Bells and Whistles , 2014, ECCV.

[21]  Tam V. Nguyen,et al.  Smart Mirror: Intelligent Makeup Recommendation and Synthesis , 2017, ACM Multimedia.

[22]  M. Stones,et al.  Emotive Factors that Make Photographs Memorable , 2009 .

[23]  Andrea Vedaldi,et al.  Understanding deep image representations by inverting them , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Stefanos Zafeiriou,et al.  300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[25]  Daniel Cohen-Or,et al.  A Humanlike Predictor of Facial Attractiveness , 2006, NIPS.

[26]  A. Cellerino,et al.  Shape analysis of female facial attractiveness , 2006, Vision Research.

[27]  G. Rhodes The evolutionary psychology of facial beauty. , 2006, Annual review of psychology.

[28]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.