Dissimilar processing of emotional facial expressions in human and monkey temporal cortex

Emotional facial expressions play an important role in social communication across primates. Despite major progress made in our understanding of categorical information processing such as for objects and faces, little is known, however, about how the primate brain evolved to process emotional cues. In this study, we used functional magnetic resonance imaging (fMRI) to compare the processing of emotional facial expressions between monkeys and humans. We used a 2×2×2 factorial design with species (human and monkey), expression (fear and chewing) and configuration (intact versus scrambled) as factors. At the whole brain level, neural responses to conspecific emotional expressions were anatomically confined to the superior temporal sulcus (STS) in humans. Within the human STS, we found functional subdivisions with a face-selective right posterior STS area that also responded to emotional expressions of other species and a more anterior area in the right middle STS that responded specifically to human emotions. Hence, we argue that the latter region does not show a mere emotion-dependent modulation of activity but is primarily driven by human emotional facial expressions. Conversely, in monkeys, emotional responses appeared in earlier visual cortex and outside face-selective regions in inferior temporal cortex that responded also to multiple visual categories. Within monkey IT, we also found areas that were more responsive to conspecific than to non-conspecific emotional expressions but these responses were not as specific as in human middle STS. Overall, our results indicate that human STS may have developed unique properties to deal with social cues such as emotional expressions.

[1]  Doris Y. Tsao,et al.  Patches with Links: A Unified System for Processing Faces in the Macaque Temporal Lobe , 2008, Science.

[2]  Beatrice eDe Gelder Frontiers in Emotion Science. The grand challenge. , 2010 .

[3]  Kevin S. LaBar,et al.  Neurocognitive mechanisms of gaze-expression interactions in face processing and social attention , 2012, Neuropsychologia.

[4]  M. Corbetta,et al.  Inter-species activity correlations reveal functional correspondences between monkey and human brain areas , 2012, Nature Methods.

[5]  G. Orban,et al.  Charting the Lower Superior Temporal Region, a New Motion-Sensitive Region in Monkey Superior Temporal Sulcus , 2006, The Journal of Neuroscience.

[6]  E. Redcay The superior temporal sulcus performs a common function for social and speech perception: Implications for the emergence of autism , 2008, Neuroscience & Biobehavioral Reviews.

[7]  E. Rolls The representation of information about faces in the temporal and frontal lobes , 2007, Neuropsychologia.

[8]  Kim Wallen,et al.  Affiliative and submissive communication in rhesus macaques , 1997, Primates.

[9]  Greg L. West,et al.  Electrophysiological Evidence for Biased Competition in V1 for Fear Expressions , 2011, Journal of Cognitive Neuroscience.

[10]  B. Rossion,et al.  Fixation Patterns During Recognition of Personally Familiar and Unfamiliar Faces , 2010, Front. Psychology.

[11]  Leslie G. Ungerleider,et al.  Object representations in the temporal cortex of monkeys and humans as revealed by functional magnetic resonance imaging. , 2009, Journal of neurophysiology.

[12]  L. P. O'Keefe,et al.  The influence of fixational eye movements on the response of neurons in area MT of the macaque , 1998, Visual Neuroscience.

[13]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[14]  N. Sadato,et al.  Attention to emotion modulates fMRI activity in human right superior temporal sulcus. , 2001, Brain research. Cognitive brain research.

[15]  Lisa A. Parr,et al.  Facial expression recognition in rhesus monkeys, Macaca mulatta , 2009, Animal Behaviour.

[16]  Nathalie Boddaert,et al.  Autism, the superior temporal sulcus and social perception , 2006, Trends in Neurosciences.

[17]  F. D. de Waal,et al.  The formal hierarchy of rhesus macaques: An investigation of the bared‐teeth display , 1985, American journal of primatology.

[18]  Leslie G. Ungerleider,et al.  Perception of emotional expressions is independent of face selectivity in monkey inferior temporal cortex , 2008, Proceedings of the National Academy of Sciences.

[19]  Andrew D. Engell,et al.  Facial expression and gaze-direction in human superior temporal sulcus , 2007, Neuropsychologia.

[20]  Robin I. M. Dunbar,et al.  Visual and socio–cognitive information processing in primate brain evolution , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  D. Amaral,et al.  Synaptic organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[22]  M. Hasselmo,et al.  The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey , 1989, Behavioural Brain Research.

[23]  D. Amaral,et al.  The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[24]  M. Peelen,et al.  Supramodal Representations of Perceived Emotions in the Human Brain , 2010, The Journal of Neuroscience.

[25]  Nikos K. Logothetis,et al.  Facial-Expression and Gaze-Selective Responses in the Monkey Amygdala , 2007, Current Biology.

[26]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[27]  Swann Pichon,et al.  Similarities and differences in perceiving threat from dynamic faces and bodies. An fMRI study , 2011, NeuroImage.

[28]  B. Gelder Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[29]  D. Hebb,et al.  Emotion in man and animal; an analysis of the intuitive processes of recognition. , 1946, Psychological review.

[30]  P. Roelfsema,et al.  Bottom-Up Dependent Gating of Frontal Signals in Early Visual Cortex , 2008, Science.

[31]  Rebecca Saxe,et al.  Live face-to-face interaction during fMRI: A new tool for social cognitive neuroscience , 2010, NeuroImage.

[32]  R. Tootell,et al.  An anterior temporal face patch in human cortex, predicted by macaque maps , 2009, Proceedings of the National Academy of Sciences.

[33]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[34]  Bridget M Waller,et al.  Facial expression categorization by chimpanzees using standardized stimuli. , 2008, Emotion.

[35]  R. Howell,et al.  Pupil Response: A Psychophysiological Measure of Fear during Analogue Desensitization , 1989, Perceptual and motor skills.

[36]  R. Adolphs Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[37]  N. Schuff,et al.  Emotion comprehension in the temporal variant of frontotemporal dementia. , 2002, Brain : a journal of neurology.

[38]  Daniel D. Dilks,et al.  Differential selectivity for dynamic versus static information in face-selective cortical regions , 2011, NeuroImage.

[39]  Aaron C. Koralek,et al.  Two Takes on the Social Brain: A Comparison of Theory of Mind Tasks , 2007, Journal of Cognitive Neuroscience.

[40]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[41]  Stephen Pain What is an Animal? , 2009 .

[42]  David G. Amaral,et al.  The role of the amygdala in primate social cognition. , 2000 .

[43]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Darren R Gitelman,et al.  ILAB: A program for postexperimental eye movement analysis , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[45]  Frans B. M. de Waal,et al.  What is an animal emotion , 2011 .

[46]  Beatrice de Gelder,et al.  The Grand Challenge for Frontiers in Emotion Science , 2010, Front. Psychology.

[47]  Laurie R Santos,et al.  Primate brains in the wild: the sensory bases for social interactions , 2004, Nature Reviews Neuroscience.

[48]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[49]  Anders M. Dale,et al.  Repeated fMRI Using Iron Oxide Contrast Agent in Awake, Behaving Macaques at 3 Tesla , 2002, NeuroImage.

[50]  G. Orban,et al.  Visual Motion Processing Investigated Using Contrast Agent-Enhanced fMRI in Awake Behaving Monkeys , 2001, Neuron.

[51]  Geoffrey M. Boynton,et al.  Efficient Design of Event-Related fMRI Experiments Using M-Sequences , 2002, NeuroImage.

[52]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[53]  Topi Tanskanen,et al.  Facial expressions of pain modulate observer's long‐latency responses in superior temporal sulcus , 2009, Human brain mapping.

[54]  Andrew D. Engell,et al.  Distributed representations of dynamic facial expressions in the superior temporal sulcus. , 2010, Journal of vision.

[55]  Giovanni Maria Carlomagno,et al.  Heat flux sensors and infrared thermography , 2007, J. Vis..

[56]  L. Brothers,et al.  A biological perspective on empathy. , 1989, The American journal of psychiatry.

[57]  C. Gross,et al.  Neural representations of faces and body parts in macaque and human cortex: a comparative FMRI study. , 2009, Journal of neurophysiology.

[58]  C. Frith,et al.  Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks , 2000, Neuropsychologia.

[59]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[60]  L. Parr,et al.  Emotional communication in primates: implications for neurobiology , 2005, Current Opinion in Neurobiology.

[61]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[62]  G. McCarthy,et al.  Dynamic perception of facial affect and identity in the human brain. , 2003, Cerebral Cortex.

[63]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[64]  E. Rolls The functions of the orbitofrontal cortex , 1999, Brain and Cognition.

[65]  Ping Wang,et al.  Cortical layer-dependent BOLD and CBV responses measured by spin-echo and gradient-echo fMRI: Insights into hemodynamic regulation , 2006, NeuroImage.

[66]  F. D. de Waal,et al.  Annals of the New York Academy of Sciences What Is an Animal Emotion? , 2022 .

[67]  Robert T. Knight,et al.  Superior Temporal SulcusIt's My Area: Or Is It? , 2008, Journal of Cognitive Neuroscience.

[68]  Aina Puce,et al.  Common and distinct brain activation to viewing dynamic sequences of face and hand movements , 2007, NeuroImage.

[69]  J. S. Morris,et al.  The functional anatomy of innate and acquired fear: Perspectives from neuroimaging , 2000 .

[70]  James K Rilling,et al.  A quantitative morphometric comparative analysis of the primate temporal lobe. , 2002, Journal of human evolution.

[71]  G. Ojemann,et al.  Organization of visuospatial functions in human cortex. Evidence from electrical stimulation. , 1982, Brain : a journal of neurology.

[72]  Doris Y. Tsao,et al.  Patches of face-selective cortex in the macaque frontal lobe , 2008, Nature Neuroscience.

[73]  Doris Y. Tsao,et al.  Faces and objects in macaque cerebral cortex , 2003, Nature Neuroscience.

[74]  Doris Y. Tsao,et al.  Comparing face patch systems in macaques and humans , 2008, Proceedings of the National Academy of Sciences.

[75]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[76]  L. Nadel,et al.  Cognitive neuroscience of emotion , 2000 .

[77]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[78]  Karl J. Friston,et al.  Experience-dependent coding of facial expression in superior temporal sulcus , 2007, Proceedings of the National Academy of Sciences.

[79]  G. Rizzolatti,et al.  Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study , 2004, Journal of Cognitive Neuroscience.

[80]  Thomas Brox,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Highly Accurate Optic Flow Computation with Theoretically Justified Warping Highly Accurate Optic Flow Computation with Theoretically Justified Warping , 2022 .

[81]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[82]  L. Parr,et al.  Facial musculature in the rhesus macaque (Macaca mulatta): evolutionary and functional contexts with comparisons to chimpanzees and humans , 2009, Journal of anatomy.