Reading sadness beyond human faces

Human faces are the main emotion displayers. Knowing that emotional compared to neutral stimuli elicit enlarged ERPs components at the perceptual level, one may wonder whether this has led to an emotional facilitation bias toward human faces. To contribute to this question, we measured the P1 and N170 components of the ERPs elicited by human facial compared to artificial stimuli, namely non-humanoid robots. Fifteen healthy young adults were shown sad and neutral, upright and inverted expressions of human versus robotic displays. An increase in P1 amplitude in response to sad displays compared to neutral ones evidenced an early perceptual amplification for sadness information. P1 and N170 latencies were delayed in response to robotic stimuli compared to human ones, while N170 amplitude was not affected by media. Inverted human stimuli elicited a longer latency of P1 and a larger N170 amplitude while inverted robotic stimuli did not. As a whole, our results show that emotion facilitation is not biased to human faces but rather extend to non-human displays, thus suggesting our capacity to read emotion beyond faces.

[1]  Shihui Han,et al.  Distinct Neurocognitive Strategies for Comprehensions of Human and Artificial Intelligence , 2008, PloS one.

[2]  A. Young,et al.  Configural information in facial expression perception. , 2000, Journal of experimental psychology. Human perception and performance.

[3]  G. Hole,et al.  Evidence for Holistic Processing of Faces Viewed as Photographic Negatives , 1999, Perception.

[4]  S. Thorpe,et al.  Rapid categorization of achromatic natural scenes: how robust at very low contrasts? , 2005, The European journal of neuroscience.

[5]  M. Balconi,et al.  In the Face of Emotions: Event-Related Potentials in Supraliminal and Subliminal Facial Expression Recognition , 2005, Genetic, social, and general psychology monographs.

[6]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[7]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[8]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[9]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[10]  Matthew S. Peterson,et al.  Visual working memory capacity for objects from different categories: A face-specific maintenance effect , 2008, Cognition.

[11]  Richard J Davidson,et al.  Spatio-temporal dynamics of brain mechanisms in aversive classical conditioning: high-density event-related potential and brain electrical tomography analyses , 2003, Neuropsychologia.

[12]  D. Amaral,et al.  The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[13]  Tetsuo Ono,et al.  Development of an Interactive Humanoid Robot "Robovie" - An interdisciplinary approach , 2001, ISRR.

[14]  I. Gauthier,et al.  A defense of the subordinate-level expertise account for the N170 component , 2002, Cognition.

[15]  Thomas Weiss,et al.  Eye movements and behavioral responses to threatening and nonthreatening stimuli during visual search in phobic and nonphobic subjects. , 2004, Emotion.

[16]  E T Bullmore,et al.  Behavioural and neurocognitive responses to sad facial affect are attenuated in patients with mania , 2004, Psychological Medicine.

[17]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[18]  Jürgen Dammers,et al.  Time course of regional brain activations during facial emotion recognition in humans , 2003, Neuroscience Letters.

[19]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[20]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[21]  A. Anderson,et al.  Emotional memory: What does the amygdala do? , 1997, Current Biology.

[22]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[23]  Luis Carretié,et al.  Automatic attention to emotional stimuli: Neural correlates , 2004, Human brain mapping.

[24]  J. Stekelenburg,et al.  The neural correlates of perceiving human bodies: an ERP study on the body-inversion effect , 2004, Neuroreport.

[25]  Diane J. Schiano,et al.  Measuring and modeling facial affect , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[26]  Andreas J Fallgatter,et al.  Face-specific event-related potential in humans is independent from facial expression. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[27]  Gary H. Glover,et al.  The neural bases of amusement and sadness: A comparison of block contrast and subject-specific emotion intensity regression approaches , 2005, NeuroImage.

[28]  P. Ekman Pictures of Facial Affect , 1976 .

[29]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[30]  L Carretié,et al.  An ERP study on the specificity of facial expression processing. , 1995, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[31]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[32]  Patrik Vuilleumier,et al.  EEG-MEG evidence for early differential repetition effects for fearful, happy and neutral faces , 2009, Brain Research.

[33]  S. McKelvie Emotional expression in upside-down faces: evidence for configurational and componential processing. , 1995, The British journal of social psychology.

[34]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[35]  D. Lehmann,et al.  Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. , 1999, Neuroreport.

[36]  Margot J. Taylor,et al.  Inversion and Contrast Polarity Reversal Affect both Encoding and Recognition Processes of Unfamiliar Faces: A Repetition Study Using ERPs , 2002, NeuroImage.

[37]  K. Mogg,et al.  Attentional selectivity for emotional faces: evidence from human electrophysiology. , 2009, Psychophysiology.

[38]  Kerstin Dautenhahn,et al.  Socially intelligent robots: dimensions of human–robot interaction , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[40]  D. Perrett,et al.  Dissociable neural responses to facial expressions of sadness and anger. , 1999, Brain : a journal of neurology.

[41]  A. Jedynak,et al.  Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli , 2003, Neuropsychologia.

[42]  R. Soussignan Duchenne smile, emotional experience, and autonomic reactivity: a test of the facial feedback hypothesis. , 2002, Emotion.

[43]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[44]  Mark W. Becker,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Early Detection and Avoidance of Threatening Faces during Passive Viewing , 2022 .

[45]  Hanna Damasio,et al.  Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex , 2001, Nature Neuroscience.

[46]  M. Farah,et al.  What causes the face inversion effect? , 1995, Journal of experimental psychology. Human perception and performance.

[47]  D. Amaral,et al.  Synaptic organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[48]  V. Goffaux,et al.  Spatio-temporal localization of the face inversion effect: an event-related potentials study , 1999, Biological Psychology.

[49]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[50]  Markus Junghöfer,et al.  Selective Visual Attention to Emotion , 2007, The Journal of Neuroscience.

[51]  P Krolak-Salmon,et al.  Processing of facial emotional expression: spatio‐temporal data as assessed by scalp event‐related potentials , 2001, The European journal of neuroscience.

[52]  K. Linkenkaer-Hansen,et al.  Face-selective processing in human extrastriate cortex around 120 ms after stimulus onset revealed by magneto- and electroencephalography , 1998, Neuroscience Letters.

[53]  Leslie G. Ungerleider,et al.  Visual awareness and the detection of fearful faces. , 2005, Emotion.

[54]  Bruno Rossion,et al.  Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170 , 2008, NeuroImage.

[55]  J. Power,et al.  The amygdaloid complex: anatomy and physiology. , 2003, Physiological reviews.

[56]  J. Fellous,et al.  Emotions: from brain to robot , 2004, Trends in Cognitive Sciences.

[57]  B. Gelder Neuroscience. More to seeing than meets the eye. , 2000 .

[58]  O. Lipp,et al.  Automatic attention does not equal automatic fear: preferential attention without implicit valence. , 2007, Emotion.

[59]  Russ Tedrake,et al.  Efficient Bipedal Robots Based on Passive-Dynamic Walkers , 2005, Science.

[60]  E. N. Sokolov,et al.  The color-vision approach to emotional space: Cortical evoked potential data , 2001, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[61]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[62]  J. Nadel,et al.  Human brain spots emotion in non humanoid robots. , 2011, Social cognitive and affective neuroscience.

[63]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[64]  I. Viaud-Delmon,et al.  Magical ideation and hyperacusis , 2008, Cortex.

[65]  Hideki Kozima,et al.  Can a robot empathize with people? , 2004, Artificial Life and Robotics.

[66]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[67]  Christoph M. Michel,et al.  Two electrophysiological stages of spatial orienting towards fearful faces: early temporo-parietal activation preceding gain control in extrastriate visual cortex , 2005, NeuroImage.

[68]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[69]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[70]  S. Campanella,et al.  Categorical Perception of Happiness and Fear Facial Expressions: An ERP Study , 2002, Journal of Cognitive Neuroscience.

[71]  J. Hietanen,et al.  Is there more in a happy face than just a big smile? , 2007 .

[72]  J. Davidoff,et al.  Brain events related to normal and moderately scrambled faces. , 1996, Brain research. Cognitive brain research.

[73]  D. Amaral,et al.  Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey , 2003, Neuroscience.

[74]  E. N. Sokolov,et al.  A psychophysiological model of emotion space , 2000, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[75]  K. Durand,et al.  The development of facial emotion recognition: the role of configural information. , 2007, Journal of experimental child psychology.

[76]  Wolfram Boucsein,et al.  Modification of N170 by different emotional expression of schematic faces , 2007, Biological Psychology.

[77]  T. Busey,et al.  Behavioral and electrophysiological evidence for configural processing in fingerprint experts , 2005, Vision Research.

[78]  Kazuo Hiraki,et al.  Differential neural responses to humans vs. robots: An event-related potential study , 2007, Brain Research.

[79]  Philippe Gaussier,et al.  Emotion understanding: robots as tools and models , 2004 .

[80]  Lola Cañamero,et al.  I show you how I like you - can you read it in my face? [robotics] , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[81]  Joseph E LeDoux Emotional networks and motor control: a fearful view. , 1996, Progress in brain research.

[82]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[83]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.