Probing the Uncanny Valley with the Eye Size Aftereffect

Natural human faces with abnormal visual features produce uncomfortable impressions, but artificial faces (e.g., robotic faces) do not necessarily do so. This is an example of the phenomenon called the uncanny valley. We hypothesized that this phenomenon indicates that natural and artificial faces are processed by different perceptual mechanisms, or they are processed differently by common mechanisms. We tested these hypotheses using a facial aftereffect where prolonged observation of adaptation faces with enlarged eyes induced a bias to underestimate the eye size of test faces. The results showed that adaptation to natural stimuli induced the aftereffect for both natural and artificial test stimuli. This suggests that the two types of faces engage common perceptual mechanisms. Adaptation to artificial stimuli also induced the aftereffect for natural test stimuli. However, artificial stimuli required a longer adaptation period (120 s) for the aftereffect to be induced compared to natural stimuli (60 s), suggesting that the processing of artificial faces by the human visual system may be inefficient. The uncanny valley may reflect that artificial faces are processed inefficiently by perceptual mechanisms that are common for processing natural and artificial faces.

[1]  J. Hietanen,et al.  Positive facial expressions are recognized faster than negative facial expressions, but why? , 2004, Psychological research.

[2]  R. Yin.  Looking at Upside-down Faces , 1969 .

[3]  David Hanson.  Exploring the Aesthetic Range for Humanoid Robots , 2006 .

[4]  Mark Hamilton,et al.  The Effect of Image Features on Judgments of Homophily, Credibility, and Intention to Use as Avatars in Future Interactions , 2009 .

[5]  S. de Schonen,et al.  Effect of visual experience on face processing: a developmental study of inversion and non-native effects. , 2004, Developmental science.

[6]  G. Schwarzer,et al.  Face processing in 8-month-old infants: evidence for configural and analytical processing , 2003, Vision Research.

[7]  M. Webster,et al.  Adaptation to natural facial categories , 2002 .

[8]  Leslie A. Zebrowitz,et al.  Facial Attractiveness: Evolutionary, Cognitive, and Social Perspectives , 2001 .

[9]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[10]  Pamela J. Hinds,et al.  Whose job is it anyway? a study of human-robot interaction in a collaborative task , 2004 .

[11]  Takayuki Kanda,et al.  Is The Uncanny Valley An Uncanny Cliff? , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[12]  Frank Biocca,et al.  The Effect of the Agency and Anthropomorphism on Users' Sense of Telepresence, Copresence, and Social Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[13]  J. Seyama.  Effect of image orientation on the eye direction aftereffect , 2006, Psychological research.

[14]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[15]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[16]  S. Baron-Cohen,et al.  Gaze Perception Triggers Reflexive Visuospatial Orienting , 1999 .

[17]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[18]  T. Busey,et al.  Seeing faces in the noise: Stochastic activity in perceptual regions of the brain may influence the perception of ambiguous stimuli , 2004, Psychonomic bulletin & review.

[19]  J. Greenberg,et al.  The Causes and Consequences of a Need for Self-Esteem: A Terror Management Theory , 1986 .

[20]  Bruno Rossion,et al.  Holistic Processing Is Finely Tuned for Faces of One's Own Race , 2006, Psychological science.

[21]  Karl F. MacDorman,et al.  Too real for comfort? Uncanny responses to computer generated faces , 2009, Comput. Hum. Behav..

[22]  Otto H. MacLin,et al.  Figural aftereffects in the perception of faces , 1999, Psychonomic bulletin & review.

[23]  H. Kobayashi,et al.  Realization of realistic and rich facial expressions by face robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[24]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[25]  Michael M. Roy,et al.  Do Dogs Resemble Their Owners? , 2004, Psychological science.

[26]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[27]  James W Tanaka,et al.  An Encoding Advantage for Own-Race versus Other-Race Faces , 2003, Perception.

[28]  S. Carey,et al.  Why faces are and are not special: an effect of expertise. , 1986, Journal of experimental psychology. General.

[29]  K. Nakayama,et al.  PSYCHOLOGICAL SCIENCE Research Article FITTING THE MIND TO THE WORLD: Face Adaptation and Attractiveness Aftereffects , 2022 .

[30]  Karl F. MacDorman,et al.  Sensitivity to the proportions of faces that vary in human likeness , 2008, Comput. Hum. Behav..

[31]  Lori A. Roggman,et al.  What makes a face attractive and why: The role of averageness in defining facial beauty. , 2002 .

[32]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[33]  M. V. von Grünau,et al.  The Detection of Gaze Direction: A Stare-In-The-Crowd Effect , 1995, Perception.

[34]  H. Deng,et al.  Building artificial humans to understand humans , 2007, Journal of Artificial Organs.

[35]  J. Brigham,et al.  Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review , 2001 .

[36]  O. Pascalis,et al.  Is Face Processing Species-Specific During the First Year of Life? , 2002, Science.

[37]  C. Chubb,et al.  The size-tuning of the face-distortion after-effect , 2001, Vision Research.

[38]  D. Perrett,et al.  Effects of sexual dimorphism on facial attractiveness , 1998, Nature.

[39]  Talma Hendler,et al.  The validity of the face-selective ERP N170 component during simultaneous recording with functional MRI , 2008, NeuroImage.

[40]  P. Schyns,et al.  Superstitious Perceptions Reveal Properties of Internal Representations , 2003, Psychological science.

[41]  N. Hadjikhani,et al.  Early (M170) activation of face-specific cortex by face-like objects , 2009, Neuroreport.

[42]  Jeremy N. Bailenson,et al.  Detecting digital chameleons , 2008, Comput. Hum. Behav..

[43]  Hiroshi Ishiguro,et al.  Toward social mechanisms of android science: A CogSci 2005 Workshop: 25 and 26 July 2005, Stresa, Italy , 2006 .

[44]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[45]  Li Gong,et al.  How social is social responses to computers? The function of the degree of anthropomorphism in computer representations , 2008, Comput. Hum. Behav..

[46]  H. Leder,et al.  Your eyes only? A test of interactive influence in the processing of facial features. , 1998, Journal of experimental psychology. Human perception and performance.

[47]  Gunter Loffler,et al.  Synthetic faces, face cubes, and the geometry of face space , 2002, Vision Research.

[48]  K. D. De Valois,et al.  Stimulus selectivity of figural aftereffects for faces. , 2005, Journal of experimental psychology. Human perception and performance.

[49]  P. Quinn,et al.  Identification of Gender in Domestic-Cat Faces with and without Training: Perceptual Learning of a Natural Categorization Task , 1999, Perception.

[50]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[51]  K. Morikawa.  Adaptation to asymmetrically distorted faces and its lack of effect on mirror images , 2005, Vision Research.

[52]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[53]  T. Valentine.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[54]  H. Ishiguro,et al.  The uncanny advantage of using androids in cognitive and social science research , 2006 .

[55]  J. Seyama,et al.  Eye direction aftereffect , 2006, Psychological research.

[56]  Hiroshi Ishiguro,et al.  Android science: Toward a new cross-interdisciplinary framework , 2005 .

[57]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[58]  Gernot Horstmann,et al.  Preattentive face processing: What do visual search experiments with schematic faces tell us? , 2007 .

[59]  S. Carey,et al.  Why faces are and are not special: an effect of expertise. , 1986 .

[60]  Tatsuya Nomura,et al.  Software agents and robots in mental therapy: psychological and sociological perspectives , 2008, AI & SOCIETY.

[61]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[62]  D. Leopold,et al.  Adaptation to complex visual patterns in humans and monkeys , 2005 .

[63]  C. Pallier,et al.  Reversibility of the Other-Race Effect in Face Recognition During Childhood , 2005, Psychological science.

[64]  V. Bruce,et al.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology When Inverted Faces Are Recognized: the Role of Configural Information in Face Recognition , 2022 .

[65]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[66]  D. Melcher,et al.  The visual system as a constraint on the survival and success of specific artworks. , 2008, Spatial vision.

[67]  Chiara Turati,et al.  Why Faces Are Not Special to Newborns , 2004 .

[68]  Jeremy N. Bailenson,et al.  Examining Virtual Busts: Are Photogrammetrically Generated Head Models Effective for Person Identification? , 2004, Presence: Teleoperators & Virtual Environments.

[69]  Emanuela Bricolo,et al.  Do all kids look alike? Evidence for an other-age effect in adults. , 2008, Journal of experimental psychology. Human perception and performance.

[70]  Mark J. Carlotto,et al.  Digital imagery analysis of unusual Martian surface features. , 1988 .

[71]  T. Kanda,et al.  Can we talk to robots? Ten-month-old infants expected interactive humanoid robots to be talked to by persons , 2005, Cognition.

[72]  Ione Fine,et al.  Face adaptation does not improve performance on search or discrimination tasks. , 2008, Journal of vision.

[73]  H. Ishiguro,et al.  Opening Pandora’s Box , 2020, Marriage Equality.

[74]  G. Winocur,et al.  What Is Special about Face Recognition? Nineteen Experiments on a Person with Visual Object Agnosia and Dyslexia but Normal Face Recognition , 1997, Journal of Cognitive Neuroscience.

[75]  M. Tarr,et al.  Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition , 1997, Vision Research.