Arousal, valence, and the uncanny valley: psychophysiological and self-report findings

The main prediction of the Uncanny Valley Hypothesis (UVH) is that observation of humanlike characters that are difficult to distinguish from the human counterpart will evoke a state of negative affect. Well-established electrophysiological [late positive potential (LPP) and facial electromyography (EMG)] and self-report [Self-Assessment Manikin (SAM)] indices of valence and arousal, i.e., the primary orthogonal dimensions of affective experience, were used to test this prediction by examining affective experience in response to categorically ambiguous compared with unambiguous avatar and human faces (N = 30). LPP and EMG provided direct psychophysiological indices of affective state during passive observation and the SAM provided self-reported indices of affective state during explicit cognitive evaluation of static facial stimuli. The faces were drawn from well-controlled morph continua representing the UVH’ dimension of human likeness (DHL). The results provide no support for the notion that category ambiguity along the DHL is specifically associated with enhanced experience of negative affect. On the contrary, the LPP and SAM-based measures of arousal and valence indicated a general increase in negative affective state (i.e., enhanced arousal and negative valence) with greater morph distance from the human end of the DHL. A second sample (N = 30) produced the same finding, using an ad hoc self-rating scale of feelings of familiarity, i.e., an oft-used measure of affective experience along the UVH’ familiarity dimension. In conclusion, this multi-method approach using well-validated psychophysiological and self-rating indices of arousal and valence rejects – for passive observation and for explicit affective evaluation of static faces – the main prediction of the UVH.

[1]  Tyler J. Burleigh,et al.  Stimulus-category competition, inhibition, and affective devaluation: a novel account of the uncanny valley , 2015, Front. Psychol..

[2]  Jordan R. Schoenherr,et al.  Uncanny sociocultural categories , 2015, Front. Psychol..

[3]  Tyler J. Burleigh,et al.  A reappraisal of the uncanny valley: categorical perception or frequency-based sensitization? , 2015, Front. Psychol..

[4]  L. Jancke,et al.  Perceptual discrimination difficulty and familiarity in the Uncanny Valley: more like a “Happy Valley” , 2014, Front. Psychol..

[5]  M. Bakermans-Kranenburg,et al.  Reliability of event-related potentials: The influence of number of trials and electrodes , 2014, Physiology & Behavior.

[6]  C. Carbon,et al.  The Fluency Amplification Model: fluent stimuli show more intense but not evidently more positive evaluations. , 2014, Acta psychologica.

[7]  C. Michel Attitudes and Evaluation , 2014 .

[8]  P. Winkielman,et al.  Easy on the eyes, or hard to categorize: Classification difficulty decreases the appeal of facial blends , 2014 .

[9]  P. Hsieh,et al.  The mere exposure effect is modulated by selective attention but not visual awareness , 2013, Vision Research.

[10]  T. Blumenthal,et al.  Your emotion or mine: labeling feelings alters emotional face perception—an ERP study on automatic and intentional affect labeling , 2013, Front. Hum. Neurosci..

[11]  Himalaya Patel,et al.  The uncanny valley does not interfere with level 1 visual perspective taking , 2013, Comput. Hum. Behav..

[12]  Tim P. Moran,et al.  The psychometric properties of the late positive potential during emotion processing and regulation , 2013, Brain Research.

[13]  L. Jancke,et al.  Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues , 2013, Journal of visualized experiments : JoVE.

[14]  Guy L. Lacroix,et al.  Does the uncanny valley exist? An empirical test of the relationship between eeriness and the human likeness of digitally created faces , 2013, Comput. Hum. Behav..

[15]  Marcus Cheetham,et al.  Category Processing and the human likeness dimension of the Uncanny Valley Hypothesis: Eye-Tracking Data , 2013, Front. Psychol..

[16]  Yuki Yamada,et al.  Categorization difficulty is associated with negative evaluation in the “uncanny valley” phenomenon , 2013 .

[17]  C. Bartneck,et al.  More human than human: does the uncanny curve really matter? , 2013, HRI 2013.

[18]  Soraia Raupp Musse,et al.  Evaluation of the Uncanny Valley in CG Characters , 2012, IVA.

[19]  Markus H. Winkler,et al.  Appraisal frames of pleasant and unpleasant pictures alter emotional responses as reflected in self-report and facial electromyographic activity. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  P. Pauli,et al.  Facial mimicry and the mirror neuron system: simultaneous acquisition of facial electromyography and functional magnetic resonance imaging , 2012, Front. Hum. Neurosci..

[21]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[22]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[23]  Anna Weinberg,et al.  Emotional targets: evaluative categorization as a function of context and content. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  Jorge Alves,et al.  Affective picture modulation: valence, arousal, attention allocation and motivational significance. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  Jelle Demanet,et al.  Valence, Arousal, and Cognitive Control: A Voluntary Task-Switching Study , 2011, Front. Psychology.

[26]  L. Jäncke,et al.  Human Neuroscience , 2022 .

[27]  P. Pauli,et al.  Processes underlying congruent and incongruent facial reactions to emotional facial expressions. , 2011, Emotion.

[28]  T. Wheatley,et al.  The Tipping Point of Animacy , 2010, Psychological science.

[29]  Karl F. MacDorman,et al.  Revisiting the uncanny valley theory: Developing and validating an alternative to the Godspeed indices , 2010, Comput. Hum. Behav..

[30]  Mark Grimshaw,et al.  Uncanny behaviour in survival horror games , 2010 .

[31]  Heather M. Claypool,et al.  Is It Familiar or Positive? Mutual Facilitation of Response Latencies , 2010 .

[32]  N. Yen,et al.  Emotional modulation of the late positive potential (LPP) generalizes to Chinese individuals. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  G. Hajcak,et al.  Event-Related Potentials, Emotion, and Emotion Regulation: An Integrative Review , 2010, Developmental neuropsychology.

[34]  Anton van Boxtel,et al.  Facial EMG as a tool for inferring affective states , 2010 .

[35]  A. Todorov,et al.  EvaluaTiNg faCES ON TruSTwOrThiNESS afTEr miNimal TimE ExpOSurE , 2009 .

[36]  Jun'ichiro Seyama,et al.  Probing the Uncanny Valley with the Eye Size Aftereffect , 2009, PRESENCE: Teleoperators and Virtual Environments.

[37]  Artur Lugmayr,et al.  Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era , 2009 .

[38]  Mark Grimshaw,et al.  Bridging the uncanny: an impossible traverse? , 2009, MindTrek '09.

[39]  Angela Tinwell Uncanny as Usability Obstacle , 2009, HCI.

[40]  Philippe Georges Zimmermann,et al.  Valence lasts longer than arousal : persistence of induced moods as assessed by psychophysiological measures , 2009 .

[41]  Karl F. MacDorman,et al.  Too real for comfort? Uncanny responses to computer generated faces , 2009, Comput. Hum. Behav..

[42]  G. Hajcak,et al.  Depression and reduced sensitivity to non-rewards versus rewards: Evidence from event-related potentials , 2009, Biological Psychology.

[43]  U. Hess,et al.  Modulation of facial reactions to avatar emotional faces by nonconscious competition priming. , 2009, Psychophysiology.

[44]  Dan Foti,et al.  Motivated and controlled attention to emotion: Time-course of the late positive potential , 2009, Clinical Neurophysiology.

[45]  Gillian Rhodes,et al.  Race Coding and the Other-Race Effect in Face Recognition , 2009, Perception.

[46]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[47]  Karl F. MacDorman,et al.  Does Japan really have robot mania? Comparing attitudes by implicit and explicit measures , 2008, AI & SOCIETY.

[48]  Karl F. MacDorman,et al.  Sensitivity to the proportions of faces that vary in human likeness , 2008, Comput. Hum. Behav..

[49]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[50]  Dan Foti,et al.  Deconstructing Reappraisal: Descriptions Preceding Arousing Pictures Modulate the Subsequent Neural Response , 2008, Journal of Cognitive Neuroscience.

[51]  Karl F. MacDorman,et al.  Human emotion and the uncanny valley: A GLM, MDS, and Isomap analysis of robot video ratings , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[52]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[53]  Dan Foti,et al.  Neural response to emotional pictures is unaffected by concurrent task difficulty: an event-related potential study. , 2007, Behavioral neuroscience.

[54]  N. Schwarz ATTITUDE CONSTRUCTION: EVALUATION IN CONTEXT , 2007 .

[55]  Heather M. Claypool,et al.  Familiar eyes are smiling: On the role of familiarity in the perception of facial affect , 2007 .

[56]  J. Hodgins,et al.  Anthropomorphism influences perception of computer-animated characters' actions. , 2007, Social cognitive and affective neuroscience.

[57]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[58]  Takayuki Kanda,et al.  Is The Uncanny Valley An Uncanny Cliff? , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[59]  Jim Blascovich,et al.  Threatened by the unexpected: physiological responses during social interactions with expectancy-violating partners. , 2007, Journal of personality and social psychology.

[60]  William A. Cunningham,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.3 Attitudes and evaluations: a social cognitive neuroscience perspective , 2022 .

[61]  H. Critchley,et al.  Neural correlates of processing valence and arousal in affective words. , 2006, Cerebral cortex.

[62]  M. Bradley,et al.  The International Affective Picture System (IAPS) in the study of emotion and attention. , 2007 .

[63]  Clas Blomberg § 32 – THE NEURAL SYSTEM , 2007 .

[64]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[65]  S. Nieuwenhuis,et al.  Reappraisal modulates the electrocortical response to unpleasant pictures , 2006, Cognitive, affective & behavioral neuroscience.

[66]  H. Ishiguro,et al.  The uncanny advantage of using androids in cognitive and social science research , 2006 .

[67]  Paul Pauli,et al.  Electromyographic responses to static and dynamic avatar emotional facial expressions. , 2006, Psychophysiology.

[68]  Michael D. Robinson,et al.  The Automaticity of Affective Reactions: Stimulus valence, arousal, and lateral spatial attention , 2006 .

[69]  Simon Rigoulot,et al.  Arousal and valence effects on event-related P3a and P3b during emotional categorization. , 2006, International Journal of Psychophysiology.

[70]  K. MacDorman,et al.  Subjective Ratings of Robot Video Clips for Human Likeness, Familiarity, and Eeriness: An Exploration of the Uncanny Valley , 2006 .

[71]  David Hanson Exploring the Aesthetic Range for Humanoid Robots , 2006 .

[72]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[73]  Andrew Olney,et al.  Upending the Uncanny Valley , 2005, AAAI.

[74]  I. Sommier Emotions , 2005, The Classical Review.

[75]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[76]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[77]  Karl F. MacDorman,et al.  Androids as an Experimental Apparatus: Why Is There an Uncanny Valley and Can We Exploit It? , 2005 .

[78]  Paul Pauli,et al.  Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response? , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[79]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[80]  S. Corkin,et al.  Two routes to emotional memory: distinct neural processes for valence and arousal. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[81]  Eliot R. Smith,et al.  On the automatic evaluation of social exemplars. , 2004, Journal of personality and social psychology.

[82]  James A. Russell,et al.  Structure of Self-Reported Current Affect : Integration and Beyond , 2004 .

[83]  Jeff T. Larsen,et al.  Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. , 2003, Psychophysiology.

[84]  J. Russell,et al.  Introduction: The return of pleasure , 2003, Cognition & emotion.

[85]  Harry T. Reis,et al.  Toward a positive psychology of relationships. , 2003 .

[86]  Melissa J. Ferguson,et al.  The constructive nature of automatic evaluation , 2003 .

[87]  Norbert Schwarz,et al.  The hedonic marking of processing fluency: Implications for evaluative judgment , 2003 .

[88]  Mark K. Johansen,et al.  Are there representational shifts during category learning? , 2002, Cognitive Psychology.

[89]  R. Cabeza,et al.  Event-related potentials of emotional memory: Encoding pleasant, unpleasant, and neutral pictures , 2002, Cognitive, affective & behavioral neuroscience.

[90]  R. Zajonc Mere Exposure: A Gateway to the Subliminal , 2001 .

[91]  Angela Y. Lee The Mere Exposure Effect: An Uncertainty Reduction Explanation Revisited , 2001 .

[92]  Bonnie L. Angelone,et al.  Visual search for a socially defined feature: What causes the search asymmetry favoring cross-race faces? , 2001, Perception & psychophysics.

[93]  D. Levin Race as a visual feature: using visual search and perceptual discrimination tasks to understand face categories and the cross-race recognition deficit. , 2000, Journal of experimental psychology. General.

[94]  R. Zajonc,et al.  Subliminal Mere Exposure: Specific, General, and Diffuse Effects , 2000, Psychological science.

[95]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[96]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[97]  U. Dimberg,et al.  Unconscious Facial Reactions to Emotional Facial Expressions , 2000, Psychological science.

[98]  J. Russell,et al.  Structure of Self-Reported Current Affect: Integration and Beyond , 1999 .

[99]  R. Dolan,et al.  Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures , 1999, Neuropsychologia.

[100]  Koen Lamberts,et al.  The time course of categorization. , 1998 .

[101]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[102]  Michael A. Becker Social Psychology: Handbook of Basic Principles , 1998 .

[103]  S. J. Steiner,et al.  A new method for off-line robot programming: applications and limitations using a virtual environment , 1997 .

[104]  M. Bradley,et al.  Motivated attention: Affect, activation, and action. , 1997 .

[105]  G. Clore,et al.  Feelings and phenomenal experiences , 1996 .

[106]  R. Bornstein,et al.  The Attribution and Discounting of Perceptual Fluency: Preliminary Tests of a Perceptual Fluency/Attributional Model of the Mere Exposure Effect , 1994 .

[107]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[108]  P. Schyns,et al.  The Ontogeny of Part Representation in Object Concepts , 1994 .

[109]  Peter J. Lang,et al.  Emotion, novelty, and the startle reflex: habituation in humans. , 1993, Behavioral neuroscience.

[110]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[111]  C. Sedikides,et al.  Differential processing of in-group and out-group information. , 1993 .

[112]  Richard J. Davidson,et al.  The neuropsychology of emotion and affective style. , 1993 .

[113]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[114]  Geoffrey Hall Perceptual and associative learning , 1991 .

[115]  U. Dimberg,et al.  Facial electromyographic reactions and autonomic activity to auditory stimuli , 1990, Biological Psychology.

[116]  P. Lang What are the Data of Emotion , 1988 .

[117]  A. J. Fridlund,et al.  Guidelines for human electromyographic research. , 1986, Psychophysiology.

[118]  J. Cacioppo,et al.  Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. , 1986, Journal of personality and social psychology.

[119]  Craig A. Smith,et al.  Patterns of cognitive appraisal in emotion. , 1985, Journal of personality and social psychology.

[120]  G. Clore,et al.  Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. , 1983 .

[121]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[122]  Richard L. Moreland,et al.  Exposure effects in person perception: Familiarity, similarity, and attraction , 1982 .

[123]  J. Russell A circumplex model of affect. , 1980 .

[124]  Miranda Robertson,et al.  Neural systems , 1977, Nature.

[125]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[126]  M. Annett A classification of hand preference by association analysis. , 1970, British journal of psychology.

[127]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[128]  J. Davitz The language of emotion , 1969 .

[129]  R. Zajonc Attitudinal effects of mere exposure. , 1968 .

[130]  George Mandler,et al.  THE RESPONSE TO THREAT - RELATIONS AMONG VERBAL AND PHYSIOLOGICAL INDEXES , 1961 .

[131]  J. M. Kittross The measurement of meaning , 1959 .

[132]  H. Schlosberg Three dimensions of emotion. , 1954, Psychological review.

[133]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .