The Role of Facial Regions in Evaluating Social Dimensions

Facial trait judgments are an important information cue for people. Recent works in the Psychology field have stated the basis of face evaluation, defining a set of traits that we evaluate from faces (e.g. dominance, trustworthiness, aggressiveness, attractiveness, threatening or intelligence among others). We rapidly infer information from others faces, usually after a short period of time (<1000ms) we perceive a certain degree of dominance or trustworthiness of another person from the face. Although these perceptions are not necessarily accurate, they influence many important social outcomes (such as the results of the elections or the court decisions). This topic has also attracted the attention of Computer Vision scientists, and recently a computational model to automatically predict trait evaluations from faces has been proposed. These systems try to mimic the human perception by means of applying machine learning classifiers to a set of labeled data. In this paper we perform an experimental study on the specific facial features that trigger the social inferences. Using previous results from the literature, we propose to use simple similarity maps to evaluate which regions of the face influence the most the trait inferences. The correlation analysis is performed using only appearance, and the results from the experiments suggest that each trait is correlated with specific facial characteristics.

[1]  R. Adolphs,et al.  The human amygdala in social judgment , 1998, Nature.

[2]  A. Eagly,et al.  What is beautiful is good, but…: A meta-analytic review of research on the physical attractiveness stereotype. , 1991 .

[3]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[4]  Antonio Torralba,et al.  Contextual Priming for Object Detection , 2003, International Journal of Computer Vision.

[5]  A. Todorov,et al.  Predicting political elections from rapid and unreflective face judgments , 2007, Proceedings of the National Academy of Sciences.

[6]  Antonio Torralba,et al.  Modeling global scene factors in attention. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  Andrew D. Engell,et al.  Understanding evaluation of faces on social dimensions , 2008, Trends in Cognitive Sciences.

[8]  C. Judd,et al.  The Influence of Afrocentric Facial Features in Criminal Sentencing , 2004, Psychological science.

[9]  David Masip,et al.  Automatic point-based facial trait judgments evaluation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Jordi Vitrià,et al.  Automatic Prediction of Facial Trait Judgments: Appearance vs. Structural Models , 2011, PloS one.

[11]  K. Rayner,et al.  Covert visual attention and extrafoveal information use during object identification , 1989, Perception & psychophysics.

[12]  Susan C. Roberts,et al.  Facial appearance affects voting decisions. , 2007 .

[13]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[14]  Leslie A. Zebrowitz,et al.  Person Perception Comes of Age: The Salience and Significance of Age in Social Judgments , 1998 .

[15]  E. Berscheid,et al.  What is beautiful is good. , 1972, Journal of personality and social psychology.

[16]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[17]  A. Todorov,et al.  The functional basis of face evaluation , 2008, Proceedings of the National Academy of Sciences.

[18]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[19]  J. Henderson,et al.  Object identification without foveal vision: Evidence from an artificial scotoma paradigm , 1997, Perception & psychophysics.

[20]  David Masip,et al.  Preferred Spatial Frequencies for Human Face Processing Are Associated with Optimal Class Discrimination in the Machine , 2008, PloS one.

[21]  Janine Willis,et al.  First Impressions , 2006, Psychological science.

[22]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[23]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[24]  A. Oliva,et al.  Flexible, Diagnosticity-Driven, Rather Than Fixed, Perceptually Determined Scale Selection in Scene and Face Recognition , 1997, Perception.

[25]  A. Oliva,et al.  Coarse Blobs or Fine Edges? Evidence That Information Diagnosticity Changes the Perception of Complex Visual Stimuli , 1997, Cognitive Psychology.

[26]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.