Facial expression of emotion and perception of the Uncanny Valley in virtual characters

With technology allowing for increased realism in video games, realistic, human-like characters risk falling into the Uncanny Valley. The Uncanny Valley phenomenon implies that virtual characters approaching full human-likeness will evoke a negative reaction from the viewer, due to aspects of the character's appearance and behavior differing from the human norm. This study investigates if ''uncanniness'' is increased for a character with a perceived lack of facial expression in the upper parts of the face. More important, our study also investigates if the magnitude of this increased uncanniness varies depending on which emotion is being communicated. Individual parameters for each facial muscle in a 3D model were controlled for the six emotions: anger, disgust, fear, happiness, sadness and surprise in addition to a neutral expression. The results indicate that even fully and expertly animated characters are rated as more uncanny than humans and that, in virtual characters, a lack of facial expression in the upper parts of the face during speech exaggerates the uncanny by inhibiting effective communication of the perceived emotion, significantly so for fear, sadness, disgust, and surprise but not for anger and happiness. Based on our results, we consider the implications for virtual character design.

[1]  J. Graftieaux.  [The uncanny]. , 2011, Annales francaises d'anesthesie et de reanimation.

[2]  Angela Tinwell.  Uncanny as Usability Obstacle , 2009, HCI.

[3]  Li Gong,et al.  How social is social responses to computers? The function of the degree of anthropomorphism in computer representations , 2008, Comput. Hum. Behav..

[4]  R. Blair,et al.  Facial expressions, their communicatory functions and neuro-cognitive substrates. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  H. Brenton,et al.  The Uncanny Valley : does it exist ? , 2005 .

[6]  Takashi Minato,et al.  Development of an Android Robot for Studying Human-Robot Interaction , 2004, IEA/AIE.

[7]  David Hanson.  Exploring the Aesthetic Range for Humanoid Robots , 2006 .

[8]  Yifan Wang,et al.  Exploring the Uncanny Valley with Japanese Video Game Characters , 2007, DiGRA Conference.

[9]  M. Cranach,et al.  Human ethology : claims and limits of a new discipline : contributions to the Colloquium , 1982 .

[10]  Ruben C. Gur,et al.  Correction: Recognition Profile of Emotions in Natural and Virtual Faces , 2008, PLoS ONE.

[11]  C. Holden.  Why is this man smiling? , 1989, Science.

[12]  F. Pollick,et al.  Recognising Facial Expression from Spatially and Temporally Modified Movements , 2003, Perception.

[13]  Cameron Anderson,et al.  Saving Face for Darwin : The Functions and Uses of Embarrassment , 1993 .

[14]  J. M. Larrazabal,et al.  Language, Knowledge, and Representation , 2004 .

[15]  Suzanne Chevalier-Skolnikoff,et al.  Darwin and Facial Expression , 2011 .

[16]  Karl F. MacDorman,et al.  Too real for comfort? Uncanny responses to computer generated faces , 2009, Comput. Hum. Behav..

[17]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[18]  S. Freud.  The Standard Edition of the Complete Psychological Works of Sigmund Freud , 1953 .

[19]  Takayuki Kanda,et al.  My robotic doppelgänger - a critical look at the Uncanny Valley , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  J. Cacioppo,et al.  WHEN WE NEED A HUMAN: MOTIVATIONAL DETERMINANTS OF ANTHROPOMORPHISM , 2008 .

[21]  The Digital Eye : Image Metrics Attempts to Leap the Uncanny Valley , 2011 .

[22]  Karl F. MacDorman,et al.  Human emotion and the uncanny valley: A GLM, MDS, and Isomap analysis of robot video ratings , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  P. Ekman.  Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life , 2003 .

[24]  Moonis Ali,et al.  Innovations in Applied Artificial Intelligence , 2005 .

[25]  Mark Grimshaw,et al.  Uncanny behaviour in survival horror games , 2010 .

[26]  Minsoo Kang,et al.  The Ambivalent Power of the Robot , 2009 .

[27]  Shrikanth Narayanan,et al.  Interplay between linguistic and affective goals in facial expression during emotional utterances , 2006 .

[28]  Konrad Campowsky,et al.  BonFIRE: A Multi-cloud Test Facility for Internet of Services Experimentation , 2012, TRIDENTCOM.

[29]  Raine Kajastila,et al.  Localization Cues Affect Emotional Judgments – Results from a User Study on Scary Sound , 2009 .

[30]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[31]  P. Ekman.  An argument for basic emotions , 1992 .

[32]  Karl F. MacDorman,et al.  Mortality salience and the uncanny valley , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[33]  P. Ekman.  Are there basic emotions? , 1992, Psychological review.

[34]  Frank E. Pollick,et al.  In Search of the Uncanny Valley , 2009, UCMedia.

[35]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[36]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[37]  Mark Grimshaw,et al.  The audio Uncanny Valley: Sound, fear and the horror game , 2009 .

[38]  Artur Lugmayr,et al.  Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era , 2009 .

[39]  Mark Grimshaw,et al.  Bridging the uncanny: an impossible traverse? , 2009, MindTrek '09.

[40]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[41]  Paul Ekman,et al.  Emotional and Conversational Nonverbal Signals , 2004 .

[42]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[43]  Klaus Mathiak,et al.  Recognition Profile of Emotions in Natural and Virtual Faces , 2008, PloS one.

[44]  L Cipolotti,et al.  Impaired social response reversal. A case of 'acquired sociopathy'. , 2000, Brain : a journal of neurology.

[45]  Karl F. MacDorman,et al.  Sensitivity to the proportions of faces that vary in human likeness , 2008, Comput. Hum. Behav..

[46]  E. Jentsch.  On the psychology of the uncanny (1906) 1 , 1997 .

[47]  K. MacDorman,et al.  Subjective Ratings of Robot Video Clips for Human Likeness, Familiarity, and Eeriness: An Exploration of the Uncanny Valley , 2006 .