Exploring Relationship Between Face and Trustworthy Impression Using Mid-level Facial Features

When people look at a face, they always build an affective subconscious impression of the person which is very useful information in social contact. Exploring relationship between facial appearance in portraits and personality impression is an interesting and challenging issue in multimedia area. In this paper, a novel method which can build relationship between facial appearance and personality impression is proposed. Low-level visual features are extracted on the defined face regions designed from psychology at first. Then, to alleviate the semantic gap between the low-level features and high-level affective features, mid-level feature set are built through clustering method. Finally, classification model is trained using our dataset. Comprehensive experiments demonstrate the effectiveness of our method by improving 26.24i¾?% in F1-measure and 54.28i¾?% in recall under similar precision comparing to state-of-the-art works. Evaluation of different mid-level feature combinations further illustrates the promising of the proposed method.

[1]  Anil K. Jain Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[2]  A. Young,et al.  Modeling first impressions from highly variable facial images , 2014, Proceedings of the National Academy of Sciences.

[3]  Fabio Celli,et al.  Automatic Personality and Interaction Style Recognition from Facebook Profile Pictures , 2014, ACM Multimedia.

[4]  Yan-Ying Chen,et al.  Facial Attribute Space Compression by Latent Human Topic Discovery , 2014, ACM Multimedia.

[5]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Shaogang Gong,et al.  Towards Person Identification and Re-identification with Attributes , 2012, ECCV Workshops.

[10]  Anil K. Jain,et al.  Suspect identification based on descriptive facial attributes , 2014, IEEE International Joint Conference on Biometrics.

[11]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[12]  Anil K. Jain,et al.  Face recognition across time lapse: On learning feature subspaces , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[13]  Lei Huang,et al.  Is Your First Impression Reliable? Trustworthy Analysis Using Facial Traits in Portraits , 2015, MMM.

[14]  David J. Kriegman,et al.  Adaptive ranking of facial attractiveness , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[15]  Shree K. Nayar,et al.  FaceTracer: A Search Engine for Large Collections of Images with Faces , 2008, ECCV.

[16]  Ankur Datta,et al.  Hierarchical ranking of facial attributes , 2011, Face and Gesture 2011.

[17]  Lei Huang,et al.  How Your Portrait Impresses People?: Inferring Personality Impressions from Portrait Contents , 2014, ACM Multimedia.