Portraits made to measure: manipulating social judgments about individuals with a statistical face model.

The social judgments people make on the basis of the facial appearance of strangers strongly affect their behavior in different contexts. However, almost nothing is known about the physical information underlying these judgments. In this article, we present a new technology (a) to quantify the information in faces that is used for social judgments and (b) to manipulate the image of a human face in a way which is almost imperceptible but changes the personality traits ascribed to the depicted person. This method was developed in a high-dimensional face space by identifying vectors that capture maximum variability in judgments of personality traits. Our method of manipulating the salience of these vectors in faces was successfully transferred to novel photographs from an independent database. We evaluated this method by showing pairs of face photographs which differed only in the salience of one of six personality traits. Subjects were asked to decide which face was more extreme with respect to the trait in question. Results show that the image manipulation produced the intended attribution effect. All response accuracies were significantly above chance level. This approach to understanding and manipulating how a person is socially perceived could be useful in psychological research and could also be applied in advertising or the film industries.

[1]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[2]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[3]  E. Berscheid,et al.  What is beautiful is good. , 1972, Journal of personality and social psychology.

[4]  J. Jaccard,et al.  LISREL Approaches to Interaction Effects in Multiple Regression , 1998 .

[5]  Leslie A. Zebrowitz,et al.  Looking Smart and Looking Good: Facial Cues to Intelligence and their Origins , 2002 .

[6]  M. Bartlett A Note on the Multiplying Factors for Various χ2 Approximations , 1954 .

[7]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[8]  L. Zebrowitz,et al.  "Wide-Eyed" and "Crooked-Faced": Determinants of Perceived and Real Honesty Across the Life Span , 1996 .

[9]  Alice J. O'Toole,et al.  Classifying adults' and children's faces by sex: computational investigations of subcategorical feature encoding , 2001, Cogn. Sci..

[10]  S. Chaiken,et al.  Dual-process theories in social psychology , 1999 .

[11]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[12]  Are There Affordances of Suggestibility in Facial Appearance? , 2006 .

[13]  M. Bartlett,et al.  A note on the multiplying factors for various chi square approximations , 1954 .

[14]  A. Eagly,et al.  What is beautiful is good, but…: A meta-analytic review of research on the physical attractiveness stereotype. , 1991 .

[15]  H. Kaiser A second generation little jiffy , 1970 .

[16]  C. Hoffman,et al.  Gender stereotypes : perception or rationalization? , 1990 .

[17]  G. Bower,et al.  Depth of processing pictures of faces and recognition memory , 1974 .

[18]  C. Macrae,et al.  A face with a cue: exploring the inevitability of person categorization , 2007 .

[19]  Olivier Corneille,et al.  When memory shifts toward more typical category exemplars: accentuation effects in the recollection of ethnically ambiguous faces. , 2004, Journal of personality and social psychology.

[20]  Hans-Peter Seidel,et al.  Exchanging Faces in Images , 2004, Comput. Graph. Forum.

[21]  Bruno Rossion,et al.  Is sex categorization from faces really parallel to face recognition? , 2002 .

[22]  P. Niedenthal,et al.  Effects of emotion concepts on perceptual memory for emotional expressions. , 2001, Journal of personality and social psychology.

[23]  Andrew D. Engell,et al.  Understanding evaluation of faces on social dimensions , 2008, Trends in Cognitive Sciences.

[24]  Heather A. Wild,et al.  Recognition and sex categorization of adults' and children's faces: examining performance in the absence of sex-stereotyped cues. , 2000, Journal of experimental child psychology.

[25]  Leslie A. Zebrowitz,et al.  Trait Impressions as Overgeneralized Responses to Adaptively Significant Facial Qualities: Evidence from Connectionist Modeling , 2003, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[26]  Olivier Corneille,et al.  Face-based categorization, context-based categorization, and distortions in the recollection of gender ambiguous faces , 2005 .

[27]  H. Kaiser,et al.  Little Jiffy, Mark Iv , 1974 .

[28]  A. Todorov,et al.  Inferences of Competence from Faces Predict Election Outcomes , 2005, Science.

[29]  Volker Blanz,et al.  Automatische Rekonstruktion der dreidimensionalen Form von Gesichtern aus einem Einzelbild , 2000 .

[30]  A. O'Toole,et al.  Sex Classification is Better with Three-Dimensional Head Structure Than with Image Intensity Information , 1997, Perception.

[31]  V Bruce,et al.  Perceiving the sex and race of faces: the role of shape and colour , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[32]  Otto H. MacLin,et al.  Racial categorization of faces: The ambiguous race face effect. , 2001 .

[33]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[34]  A. Todorov,et al.  The functional basis of face evaluation , 2008, Proceedings of the National Academy of Sciences.

[35]  M. Heesacker,et al.  Likability of targets and distractors in facial recognition. , 1984, The American journal of psychology.

[36]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[37]  Nicholas O. Rule,et al.  The Face of Success Inferences from Chief Executive Officers' Appearance Predict Company Profits , 2008 .

[38]  J Blumenthal,et al.  Bright, bad, babyfaced boys: appearance stereotypes do not always yield self-fulfilling prophecy effects. , 1998, Journal of personality and social psychology.

[39]  O. Corneille,et al.  Locating attractiveness in the face space: Faces are more attractive when closer to their group prototype , 2008, Psychonomic bulletin & review.

[40]  Joann M. Montepare,et al.  The Contribution of Emotion Perceptions and Their Overgeneralizations to Trait Impressions , 2003 .

[41]  Nikolaus F. Troje,et al.  How is bilateral symmetry of human faces used for recognition of novel views? , 1998, Vision Research.

[42]  Thomas Vetter,et al.  Three-dimensional shape and two-dimensional surface reflectance contributions to face recognition: an application of three-dimensional morphing , 1999, Vision Research.

[43]  Sami Romdhani,et al.  Estimating 3D shape and texture using pixel intensity, edges, specular highlights, texture constraints and a prior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[44]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.