Neural Coding of Cooperative vs. Affective Human Interactions: 150 ms to Code the Action's Purpose

The timing and neural processing of the understanding of social interactions was investigated by presenting scenes in which 2 people performed cooperative or affective actions. While the role of the human mirror neuron system (MNS) in understanding actions and intentions is widely accepted, little is known about the time course within which these aspects of visual information are automatically extracted. Event-Related Potentials were recorded in 35 university students perceiving 260 pictures of cooperative (e.g., 2 people dragging a box) or affective (e.g., 2 people smiling and holding hands) interactions. The action's goal was automatically discriminated at about 150–170 ms, as reflected by occipito/temporal N170 response. The swLORETA inverse solution revealed the strongest sources in the right posterior cingulate cortex (CC) for affective actions and in the right pSTS for cooperative actions. It was found a right hemispheric asymmetry that involved the fusiform gyrus (BA37), the posterior CC, and the medial frontal gyrus (BA10/11) for the processing of affective interactions, particularly in the 155–175 ms time window. In a later time window (200–250 ms) the processing of cooperative interactions activated the left post-central gyrus (BA3), the left parahippocampal gyrus, the left superior frontal gyrus (BA10), as well as the right premotor cortex (BA6). Women showed a greater response discriminative of the action's goal compared to men at P300 and anterior negativity level (220–500 ms). These findings might be related to a greater responsiveness of the female vs. male MNS. In addition, the discriminative effect was bilateral in women and was smaller and left-sided in men. Evidence was provided that perceptually similar social interactions are discriminated on the basis of the agents' intentions quite early in neural processing, differentially activating regions devoted to face/body/action coding, the limbic system and the MNS.

[1]  Dietrich Lehmann,et al.  Affective Judgments of Faces Modulate Early Activity (∼160 ms) within the Fusiform Gyri , 2002, NeuroImage.

[2]  J. Decety,et al.  Gender Differences in the Mu Rhythm of the Human Mirror-Neuron System , 2008, PloS one.

[3]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[4]  Rebecca C. Knickmeyer,et al.  Sex Differences in the Brain: Implications for Explaining Autism , 2005, Science.

[5]  D Yves von Cramon,et al.  Sequences of Abstract Nonbiological Stimuli Share Ventral Premotor Cortex with Action Observation and Imagery , 2004, The Journal of Neuroscience.

[6]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[7]  W. Prinz,et al.  N400-like negativities in action perception reflect the activation of two components of an action representation , 2009, Social neuroscience.

[8]  O. Tzeng,et al.  Sex differences in the neuroanatomy of human mirror-neuron system: A voxel-based morphometric investigation , 2009, Neuroscience.

[9]  Alice Mado Proverbio,et al.  Sex differences in the brain response to affective scenes with or without humans , 2009, Neuropsychologia.

[10]  Werner Lutzenberger,et al.  Social interaction revealed by motion: dynamics of neuromagnetic gamma activity. , 2010, Cerebral cortex.

[11]  U. Frith,et al.  Do triangles play tricks? Attribution of mental states to animated shapes in normal and abnormal development , 2000 .

[12]  Victoria J. Bourne.  Lateralised processing of positive facial emotion: sex differences in strength of hemispheric dominance , 2005, Neuropsychologia.

[13]  Alison J. Wiggett,et al.  The role of the extrastriate body area in action perception , 2006, Social neuroscience.

[14]  Ehud Zohary,et al.  Watching Others' Actions: Mirror Representations in the Parietal Cortex , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[15]  Scott T. Grafton,et al.  Understanding Actions of Others: The Electrodynamics of the Left and Right Hemispheres. A High-Density EEG Neuroimaging Study , 2010, PloS one.

[16]  E. Pang,et al.  Recognising upright and inverted faces: MEG source localisation , 2011, Brain Research.

[17]  R. Adorni,et al.  Neural markers of a greater female responsiveness to social stimuli , 2008, BMC Neuroscience.

[18]  Scott T. Grafton,et al.  Action outcomes are represented in human inferior frontoparietal cortex. , 2008, Cerebral cortex.

[19]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[20]  Jean-Luc Anton,et al.  Recruitment of Both the Mirror and the Mentalizing Networks When Observing Social Interactions Depicted by Point-Lights: A Neuroimaging Study , 2011, PloS one.

[21]  Frithjof Kruggel,et al.  Gender and age effects in structural brain asymmetry as measured by MRI texture analysis , 2003, NeuroImage.

[22]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[23]  Simon Baron-Cohen,et al.  The Friendship Questionnaire: An Investigation of Adults with Asperger Syndrome or High-Functioning Autism, and Normal Sex Differences , 2003, Journal of autism and developmental disorders.

[24]  Patric Bach,et al.  Communicating hands: ERPs elicited by meaningful symbolic hand postures , 2004, Neuroscience Letters.

[25]  A. Proverbio,et al.  Processing valence and intensity of infant expressions: the roles of expertise and gender. , 2007, Scandinavian journal of psychology.

[26]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[27]  J. Mazziotta,et al.  Mapping motor representations with positron emission tomography , 1994, Nature.

[28]  Christian Keysers,et al.  Acting together in and beyond the mirror neuron system , 2009, NeuroImage.

[29]  B. Rossion,et al.  Event-related potentials and time course of the ‘other-race’ face classification advantage , 2004, Neuroreport.

[30]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[31]  Alice Mado Proverbio,et al.  Observation of Static Pictures of Dynamic Actions Enhances the Activity of Movement-Related Brain Areas , 2009, PloS one.

[32]  P S Goldman-Rakic,et al.  Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: evidence for intrinsic specialization of neuronal coding. , 1999, Cerebral cortex.

[33]  Daniel Houser,et al.  A functional imaging study of cooperation in two-person reciprocal exchange , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Jessica K. Hodgins,et al.  Exploring the neural correlates of goal-directed action and intention understanding , 2011, NeuroImage.

[35]  A. Proverbio,et al.  Gender differences in hemispheric asymmetry for face processing , 2006, BMC Neuroscience.

[36]  T. Troyer,et al.  Resonant responses to variance modulation in stochastic integrate-and-fire neurons , 2007, BMC Neuroscience.

[37]  R. Jaenisch,et al.  Neurotrophin‐3 and trkC in muscle are non‐essential for the development of mouse muscle spindles , 1998, Neuroreport.

[38]  Thomas R. Knösche,et al.  ASA-Advanced Source Analysis of Continuous and Event-Related EEG/MEG Signals , 2003, Brain Topography.

[39]  David Boles,et al.  Sex differences in spatial ability: A lateralization of function approach , 2004, Brain and Cognition.

[40]  J. Decety,et al.  Gender differences in the mu rhythm during empathy for pain: An electroencephalographic study , 2009, Brain Research.

[41]  J. Pineda.  Behavioral and Brain Functions BioMed Central Review , 2008 .

[42]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Kevin A. Pelphrey,et al.  Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception , 2004, Journal of Cognitive Neuroscience.

[44]  A. H Kemp,et al.  Gender differences in the cortical electrophysiological processing of visual emotional stimuli , 2004, NeuroImage.

[45]  Riitta Hari,et al.  Three hands: fragmentation of human bodily awareness , 1998, Neuroscience Letters.

[46]  B. Renault,et al.  Electrophysiological correlates of facial decision: insights from upright and upside-down Mooney-face perception. , 2005, Brain research. Cognitive brain research.

[47]  R. Hari,et al.  Modulated Activation of the Human SI and SII Cortices during Observation of Hand Actions , 2002, NeuroImage.

[48]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[49]  Mikko Sams,et al.  Viewing speech modulates activity in the left SI mouth cortex , 2005, NeuroImage.

[50]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[51]  J. Pineda,et al.  Recognition of point-light biological motion: Mu rhythms and mirror neuron activity , 2007, Behavioural Brain Research.

[52]  J. O'Doherty,et al.  Empathic neural responses are modulated by the perceived fairness of others , 2006, Nature.

[53]  A. Proverbio,et al.  When neurons do not mirror the agent's intentions: Sex differences in neural coding of goal-directed actions , 2010, Neuropsychologia.

[54]  Nadim Joni Shah,et al.  Gender differences in brain networks supporting empathy , 2008, NeuroImage.

[55]  T. Allison,et al.  Brain Activity Evoked by the Perception of Human Walking: Controlling for Meaningful Coherent Motion , 2003, The Journal of Neuroscience.

[56]  Yoshiro Okubo,et al.  Enhanced activation in the extrastriate body area by goal‐directed actions , 2008, Psychiatry and clinical neurosciences.

[57]  Matthew W. Hahn,et al.  Ancient and Recent Positive Selection Transformed Opioid cis-Regulation in Humans , 2005, PLoS biology.

[58]  Jiro Gyoba,et al.  Event-related potentials during the evaluation of the appropriateness of cooperative actions , 2009, Neuroscience Letters.

[59]  Blake W. Johnson,et al.  Cerebral asymmetry for mental rotation: effects of response hand, handedness and gender , 2002, Neuroreport.

[60]  M. Iacoboni,et al.  Getting a grip on other minds: Mirror neurons, intention understanding, and cognitive empathy , 2006, Social Neuroscience.

[61]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[62]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[63]  R. Adolphs.  Cognitive neuroscience: Cognitive neuroscience of human social behaviour , 2003, Nature Reviews Neuroscience.

[64]  Gereon R. Fink,et al.  Mirror Neuron and Theory of Mind Mechanisms Involved in Face-to-Face Interactions: A Functional Magnetic Resonance Imaging Approach to Empathy , 2007, Journal of Cognitive Neuroscience.

[65]  Steven Laureys,et al.  Cytology and functionally correlated circuits of human posterior cingulate areas , 2006, NeuroImage.

[66]  S. Fecteau,et al.  A motor resonance mechanism in children? Evidence from subdural electrodes in a 36-month-old child , 2004, Neuroreport.

[67]  S. Herpertz,et al.  Oxytocin Improves “Mind-Reading” in Humans , 2007, Biological Psychiatry.

[68]  Werner Lutzenberger,et al.  Cortical response to social interaction is affected by gender , 2010, NeuroImage.

[69]  Jonathan B Freeman,et al.  The face-sensitive N170 encodes social category information , 2010, Neuroreport.

[70]  J. Mazziotta,et al.  Grasping the Intentions of Others with One's Own Mirror Neuron System , 2005, PLoS biology.

[71]  Peter A Tass,et al.  swLORETA: a novel approach to robust source localization and synchronization tomography , 2007, Physics in medicine and biology.

[72]  S. Bentin,et al.  Mirror activity in the human brain while observing hand movements: A comparison between EEG desynchronization in the μ-range and previous fMRI results , 2009, Brain Research.

[73]  L. Katz,et al.  Sex differences in the functional organization of the brain for language , 1995, Nature.

[74]  Teodora Gliga,et al.  Structural Encoding of Body and Face in Human Infants and Adults , 2005, Journal of Cognitive Neuroscience.

[75]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[76]  Istvan Molnar-Szakacs,et al.  Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline , 2004, NeuroImage.

[77]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[78]  Patrice D. Tremoulet,et al.  The influence of spatial context and the role of intentionality in the interpretation of animacy from motion , 2006, Perception & psychophysics.

[79]  Raymond H. Cuijpers,et al.  The role of inferior frontal and parietal areas in differentiating meaningful and meaningless object-directed actions , 2010, Brain Research.

[80]  U. Habel,et al.  Gender differences in regional cerebral activity during sadness , 2000, Human brain mapping.

[81]  M. Zotto,et al.  Gender and parental status affect the visual cortical response to infant facial expression , 2006, Neuropsychologia.

[82]  E. Bullmore,et al.  Investigation of facial recognition memory and happy and sad facial expression perception: an fMRI study , 1998, Psychiatry Research: Neuroimaging.

[83]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[84]  Istvan Molnar-Szakacs,et al.  Observing complex action sequences: The role of the fronto-parietal mirror neuron system , 2006, NeuroImage.

[85]  R. Henson,et al.  Electrophysiological and haemodynamic correlates of face perception, recognition and priming. , 2003, Cerebral cortex.

[86]  G. Rizzolatti,et al.  Neural Circuits Underlying Imitation Learning of Hand Actions An Event-Related fMRI Study , 2004, Neuron.

[87]  S. Baron-Cohen,et al.  The Empathy Quotient: An Investigation of Adults with Asperger Syndrome or High Functioning Autism, and Normal Sex Differences , 2004, Journal of autism and developmental disorders.