The Uncanny Valley Effect

The Uncanny Valley Effect (UVE) first emerged as a warning against making industrial robots appear so highly human-like that they could unsettle the real humans around them. It proposed a specific pattern of negative emotional responses to entities that were almost but not quite human, and has been proposed as the reason why some entities such as dolls, mannequins and zombies may appear unsettling. The aim of this thesis was to move beyond an anecdotal explanation to understand more about the perception of near-human faces, and how this compares to the perception of human and non-human faces. The aims were to explore the relationship between the human-likeness of faces and emotional responses to them, to understand reactions to and descriptions of near-human faces, to explore aspects of how near-human faces are processed and to explore whether mismatched emotional expressions might contribute to the perception of some near-human faces as eerie. Five studies were carried out using face images whose human-likeness was systematically controlled or measured. A non-linear relationship between human-likeness and eeriness was found, but the near-human faces were not always the eeriest images. Near-human faces were found to be subject to the effects of inversion, and inversion was found to heighten perceptions of eeriness. Faces were created which contained mismatched emotional expressions, and the blends combining happy faces with angry or fearful eyes were rated as the most eerie. Incongruities between aspects of appearance or behaviour had been cited as explanations for the UVE in the past but this thesis presents the first evidence that differences in eeriness may result from incongruities between emotional expressions. Directions for future research have been suggested to explore these findings in a wider context and to understand more about the UVE.

[1]  J. Graftieaux [The uncanny]. , 2011, Annales francaises d'anesthesie et de reanimation.

[2]  G. Pike,et al.  Developmental Changes in the Effect of Inversion: Using a Picture Book to Investigate Face Recognition , 2001, Perception.

[3]  H. Ishiguro,et al.  The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions , 2011, Social cognitive and affective neuroscience.

[4]  Guy L. Lacroix,et al.  Does the uncanny valley exist? An empirical test of the relationship between eeriness and the human likeness of digitally created faces , 2013, Comput. Hum. Behav..

[5]  Marte Fallshore,et al.  Recognition of Emotion from Inverted Schematic Drawings of Faces , 2003, Perceptual and motor skills.

[6]  H D Ellis,et al.  Accounting for Delusional Misidentifications , 1990, British Journal of Psychiatry.

[7]  Jason Tipples,et al.  Wide eyes and an open mouth enhance facial threat , 2007 .

[8]  Karl F. MacDorman,et al.  Mortality salience and the uncanny valley , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[9]  Mel Slater,et al.  Physiological Responses to Breaks in Presence: A Pilot Study , 2003 .

[10]  L. Jäncke,et al.  Human Neuroscience , 2022 .

[11]  Karl F. MacDorman,et al.  Androids as an Experimental Apparatus: Why Is There an Uncanny Valley and Can We Exploit It? , 2005 .

[12]  C. Macrae,et al.  The face and person perception: insights from social cognition. , 2011, British journal of psychology.

[13]  Angela Tinwell,et al.  Perception of psychopathy and the Uncanny Valley in virtual characters , 2013, Comput. Hum. Behav..

[14]  Michael B. Lewis,et al.  Attention misplaced: the role of diagnostic features in the face-inversion effect. , 2011, Journal of experimental psychology. Human perception and performance.

[15]  K. Durand,et al.  The development of facial emotion recognition: the role of configural information. , 2007, Journal of experimental child psychology.

[16]  Leslie B. Cohen,et al.  Do 7-month-old infants process independent features or facial configurations? , 2001 .

[17]  T. Valentine Upside-down faces: a review of the effect of inversion upon face recognition. , 1988, British journal of psychology.

[18]  D. Lewkowicz,et al.  The development of the uncanny valley in infants. , 2012, Developmental psychobiology.

[19]  S. Carey,et al.  Developmental changes in the representation of faces. , 1977, Journal of experimental child psychology.

[20]  Hadyn D. Ellis,et al.  Reduced autonomic responses to faces in Capgras delusion , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  N. Suzuki,et al.  Morphed Images of Basic Emotional Expressions: Ratings on Russell's Bipolar Field , 1997, Perceptual and motor skills.

[22]  P. Thompson,et al.  Margaret Thatcher: A New Illusion , 1980, Perception.

[23]  A. Freire,et al.  The Face-Inversion Effect as a Deficit in the Encoding of Configural Information: Direct Evidence , 2000, Perception.

[24]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[25]  Mark Grimshaw,et al.  Facial expression of emotion and perception of the Uncanny Valley in virtual characters , 2011, Comput. Hum. Behav..

[26]  O. Lipp,et al.  No effect of inversion on attentional and affective processing of facial expressions. , 2009, Emotion.

[27]  Robin R. Vallacher,et al.  Implicit Psychology: An Introduction to Social Cognition , 1977 .

[28]  Ana Paiva,et al.  The influence of empathy in human-robot relations , 2013, Int. J. Hum. Comput. Stud..

[29]  Karl F. MacDorman,et al.  Sensitivity to the proportions of faces that vary in human likeness , 2008, Comput. Hum. Behav..

[30]  Christian Wallraven,et al.  Two Routes to Face Perception: Evidence From Psychophysics and Computational Modeling , 2009, Cogn. Sci..

[31]  Francisco Esteves,et al.  The face of wrath: The role of features and configurations in conveying social threat , 2004, Cognition & emotion.

[32]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[33]  James M. Honeycutt,et al.  A Cross-Cultural Analysis of Imagined Interactions , 2006 .

[34]  Lola Cañamero,et al.  Did Garbo care about the uncanny valley , 2006 .

[35]  M. Farah,et al.  What causes the face inversion effect? , 1995, Journal of experimental psychology. Human perception and performance.

[36]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[37]  D. Perrett,et al.  Computer-enhanced emotion in facial expressions , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[38]  Karl F. MacDorman,et al.  Too real for comfort? Uncanny responses to computer generated faces , 2009, Comput. Hum. Behav..

[39]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[40]  David I. Perrett,et al.  Evolution and individual differences in the perception of attractiveness: How cyclic hormonal changes and self-perceived attractiveness influence female preferences for male faces. , 2002 .

[41]  H. Ishiguro,et al.  EXPLORING THE UNCANNY VALLEY WITH GEMINOID HI-1 IN A REAL-WORLD APPLICATION , 2010 .

[42]  J. Hodgins,et al.  Anthropomorphism influences perception of computer-animated characters' actions. , 2007, Social cognitive and affective neuroscience.

[43]  M Coltheart,et al.  MODELS OF FACE RECOGNITION AND DELUSIONAL MISIDENTIFICATION: A CRITICAL REVIEW , 2000, Cognitive neuropsychology.

[44]  K. Okanoya,et al.  Infants prefer the faces of strangers or mothers to morphed faces: an uncanny valley between social novelty and familiarity , 2012, Biology Letters.

[45]  James M. Honeycutt,et al.  Imagined interaction as an element of social cognition , 1988 .

[46]  Lisa M. DeBruine,et al.  The many faces of research on face perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[47]  R. Bauer The Cognitive Psychophysiology of Prosopagnosia , 1986 .

[48]  Gary L. Allen,et al.  Seeking a Common Gestalt Approach to the Perception of Faces, Objects, and Scenes , 2006 .

[49]  G. Young In what sense ‘familiar’? Examining experiential differences within pathologies of facial recognition , 2009, Consciousness and Cognition.

[50]  Russell Beale,et al.  Psychological responses to simulated displays of mismatched emotional expressions , 2008, Interact. Comput..

[51]  James M. Honeycutt,et al.  Imagined Interaction and Interpersonal Communication , 1990 .

[52]  Tomoko Koda,et al.  Eloquence of eyes and mouth of virtual agents: cultural study of facial expression perception , 2017, AI & SOCIETY.

[53]  K. MacDorman,et al.  Subjective Ratings of Robot Video Clips for Human Likeness, Familiarity, and Eeriness: An Exploration of the Uncanny Valley , 2006 .

[54]  J. Langlois,et al.  Maxims or myths of beauty? A meta-analytic and theoretical review. , 2000, Psychological bulletin.

[55]  J. Krosnick,et al.  Survey research. , 1999, Annual review of psychology.

[56]  Tehmina N. Basit Manual or electronic? The role of coding in qualitative data analysis , 2003 .

[57]  D. Lundqvist,et al.  Facial expressions of emotion (KDEF): Identification under different display-duration conditions , 2008, Behavior research methods.

[58]  Mel Slater,et al.  Presence and The Sixth Sense , 2002, Presence: Teleoperators & Virtual Environments.

[59]  A. Fallon,et al.  A perspective on disgust. , 1987, Psychological review.

[60]  J. Micheal Gotcher,et al.  Coping Strategies of Cancer Patients: Actual Communication and Imagined Interactions , 1990 .

[61]  Betty Swift Preparing Numerical Data , 2006 .

[62]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[63]  Andrew Olney,et al.  Upending the Uncanny Valley , 2005, AAAI.

[64]  Takayuki Kanda,et al.  Is The Uncanny Valley An Uncanny Cliff? , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[65]  Mahdi Muhammad Moosa,et al.  Danger Avoidance: An Evolutionary Explanation of Uncanny Valley , 2010 .

[66]  Tom Geller,et al.  Overcoming the Uncanny Valley , 2008, IEEE Computer Graphics and Applications.

[67]  Frank E. Pollick,et al.  In Search of the Uncanny Valley , 2009, UCMedia.

[68]  P. Ekman An argument for basic emotions , 1992 .

[69]  Tekla Perry Leaving the uncanny valley behind , 2014, IEEE Spectrum.

[70]  Asif A Ghazanfar,et al.  Monkey visual behavior falls into the uncanny valley , 2009, Proceedings of the National Academy of Sciences.

[71]  Francisco Esteves,et al.  The Face of Wrath: Critical Features for Conveying Facial Threat , 1999 .

[72]  L. Riek,et al.  Real-Time Empathy : Facial Mimicry on a Robot , 2008 .

[73]  N. G. Hanawalt,et al.  The RÔle of the Upper and the Lower Parts of the Face as a Basis for Judging Facial Expressions: II. In Posed Expressions and “Candid-Camera” Pictures , 1944 .

[74]  Claire Hewson Conducting research on the Internet. , 2003 .

[75]  M S Horswill,et al.  User-controlled photographic animations, photograph-based questions, and questionnaires: Three Internet-based instruments for measuring drivers’ risk-taking behavior , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[76]  R. Yin Looking at Upside-down Faces , 1969 .

[77]  J. Russell Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[78]  Victoria J. Bourne,et al.  Face Processing: Psychological, Neuropsychological, and Applied Perspectives , 2010 .

[79]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[80]  Yifan Wang,et al.  Exploring the Uncanny Valley with Japanese Video Game Characters , 2007, DiGRA Conference.

[81]  Jasia Reichardt Robots: Fact, Fiction and Prediction , 1978 .

[82]  Christoph Bartneck,et al.  The inversion effect in HRI: Are robots perceived more like humans or objects? , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[83]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[84]  S. Baron-Cohen,et al.  Is There a "Language of the Eyes"? Evidence from Normal Adults, and Adults with Autism or Asperger Syndrome , 1997 .

[85]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[86]  Kazuhiko Kawamura,et al.  Uncanny valley revisited , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[87]  Ulf-Dietrich Reips,et al.  The methodology of Internet-based experiments , 2009 .

[88]  A. Young,et al.  Configural information in facial expression perception. , 2000, Journal of experimental psychology. Human perception and performance.

[89]  Gillian Rhodes,et al.  What's lost in inverted faces? , 1993, Cognition.

[90]  Mark Grimshaw,et al.  Bridging the uncanny: an impossible traverse? , 2009, MindTrek '09.

[91]  L. Phillips,et al.  Processing orientation and emotion recognition. , 2012, Emotion.

[92]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[93]  P. Ekman,et al.  Smiles when lying. , 1988, Journal of personality and social psychology.

[94]  Maya B. Mathur,et al.  An uncanny game of trust: Social trustworthiness of robots inferred from subtle anthropomorphic facial cues , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[95]  Himalaya Patel,et al.  The uncanny valley does not interfere with level 1 visual perspective taking , 2013, Comput. Hum. Behav..

[96]  D. Pugh,et al.  How to Get a PhD: A Handbook for Students and Their Supervisors , 1994 .

[97]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[98]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[99]  T. Ziemke,et al.  Some methodological issues in android science , 2006 .

[100]  Mark Grimshaw,et al.  The Uncanny Wall , 2011, Int. J. Arts Technol..

[101]  N. Kanwisher,et al.  The Neural Basis of the Behavioral Face-Inversion Effect , 2005, Current Biology.

[102]  D. Wegner,et al.  Feeling robots and human zombies: Mind perception and the uncanny valley , 2012, Cognition.

[103]  Nick Donnelly,et al.  Perceptual and decisional factors influencing the discrimination of inversion in the Thatcher illusion. , 2011, Journal of experimental psychology. Human perception and performance.

[104]  G. Rhodes,et al.  Holistic Processing of Faces in Preschool Children and Adults , 2003, Psychological science.

[105]  James M. Donovan Facial Attractiveness : Evolutionary , Cognitive , and Social Perspectives , 2003 .

[106]  Minsoo Kang,et al.  The Ambivalent Power of the Robot , 2009 .

[107]  Hiroshi Ishiguro,et al.  The Perception of Humans and Robots: Uncanny Hills in Parietal Cortex , 2010 .

[108]  Hiroshi Ishiguro,et al.  Uncanny Valley of Androids and Its Lateral Inhibition Hypothesis , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[109]  Marcus Cheetham,et al.  Category Processing and the human likeness dimension of the Uncanny Valley Hypothesis: Eye-Tracking Data , 2013, Front. Psychol..

[110]  Glenda C. Prkachin,et al.  The effects of orientation on detection and identification of facial expressions of emotion. , 2003, British journal of psychology.

[111]  C. Frith Social cognition , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[112]  A. Young,et al.  In the Eye of the Beholder: The Science of Face Perception , 1998 .

[113]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[114]  Mark Grimshaw,et al.  Uncanny behaviour in survival horror games , 2010 .

[115]  Andy Field,et al.  Discovering statistics using SPSS, 2nd ed. , 2005 .

[116]  J. Bartlett,et al.  Inversion and processing of component and spatial-relational information in faces. , 1996, Journal of experimental psychology. Human perception and performance.

[117]  Karl F. MacDorman,et al.  Human emotion and the uncanny valley: A GLM, MDS, and Isomap analysis of robot video ratings , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[118]  M. Yuki,et al.  Are the windows to the soul the same in the East and West? Cultural differences in using the eyes and mouth as cues to recognize emotions in Japan and the United States , 2007 .

[119]  Sarah N. Woods,et al.  Exploring the design space of robots: Children's perspectives , 2006, Interact. Comput..

[120]  Angela Tinwell Uncanny as Usability Obstacle , 2009, HCI.

[121]  Scott G. Eberle Exploring the Uncanny Valley to Find the Edge of Play. , 2009 .

[122]  J. N. Bassili Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[123]  H. Brenton,et al.  The Uncanny Valley : does it exist ? , 2005 .

[124]  Martin Breidt,et al.  Face reality: investigating the Uncanny Valley for virtual faces , 2010, SIGGRAPH ASIA.

[125]  Kurt Hugenberg,et al.  Faces are Central to Social Cognition , 2013 .

[126]  D. Fessler,et al.  Normative Bias and Adaptive Challenges: A Relational Approach to Coalitional Psychology and a Critique of Terror Management Theory , 2005 .

[127]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[128]  Jun'ichiro Seyama,et al.  Probing the Uncanny Valley with the Eye Size Aftereffect , 2009, PRESENCE: Teleoperators and Virtual Environments.