Object visibility alters the relative contribution of ventral visual stream and mirror neuron system to goal anticipation during action observation

We used fMRI to study the effect of hiding the target of a grasping action on the cerebral activity of an observer whose task was to anticipate the size of the object being grasped. Activity in the putative mirror neuron system (pMNS) was higher when the target was concealed from the view of the observer and anticipating the size of the object being grasped requested paying attention to the hand kinematics. In contrast, activity in ventral visual areas outside the pMNS increased when the target was fully visible, and the performance improved in this condition. A repetition suppression analysis demonstrated that in full view, the size of the object being grasped by the actor was encoded in the ventral visual stream. Dynamic causal modeling showed that monitoring a grasping action increased the coupling between the parietal and ventral premotor nodes of the pMNS. The modulation of the functional connectivity between these nodes was correlated with the subject's capability to detect the size of hidden objects. In full view, synaptic activity increased within the ventral visual stream, and the connectivity with the pMNS was diminished. The re-enactment of observed actions in the pMNS is crucial when interpreting others' actions requires paying attention to the body kinematics. However, when the context permits, visual-spatial information processing may complement pMNS computations for improved action anticipation accuracy.

[1]  G. Orban,et al.  Action Observation Circuits in the Macaque Monkey Cortex , 2011, The Journal of Neuroscience.

[2]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[3]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  Laurel J Buxbaum,et al.  Critical brain regions for action recognition: lesion symptom mapping in left hemisphere stroke. , 2010, Brain : a journal of neurology.

[5]  David J. Heeger,et al.  A mirror up to nature , 2008, Current Biology.

[6]  Gregory Hickok,et al.  Eight Problems for the Mirror Neuron Theory of Action Understanding in Monkeys and Humans , 2009, Journal of Cognitive Neuroscience.

[7]  G. Rizzolatti,et al.  The Cortical Motor System , 2001, Neuron.

[8]  Michael Erb,et al.  Visual features of an observed agent do not modulate human brain activity during action observation , 2009, NeuroImage.

[9]  Christian Keysers,et al.  Aplasics Born without Hands Mirror the Goal of Hand Actions with Their Feet , 2007, Current Biology.

[10]  Ehud Zohary,et al.  A Mirror Representation of Others' Actions in the Human Anterior Parietal Cortex , 2006, The Journal of Neuroscience.

[11]  Scott T. Grafton,et al.  Action outcomes are represented in human inferior frontoparietal cortex. , 2008, Cerebral cortex.

[12]  G Rizzolatti,et al.  When pliers become fingers in the monkey motor system , 2008, Proceedings of the National Academy of Sciences.

[13]  Melvyn A. Goodale,et al.  Category-specific neural processing for naming pictures of animals and naming pictures of tools: An ALE meta-analysis , 2010, Neuropsychologia.

[14]  G. Rizzolatti,et al.  Further reflections on how we interpret the actions of others , 2008, Nature.

[15]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[16]  M. Erb,et al.  Object presence modulates activity within the somatosensory component of the action observation network. , 2012, Cerebral cortex.

[17]  N. Kanwisher,et al.  The Human Body , 2001 .

[18]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[19]  R. Vogels,et al.  Repetition Probability Does Not Affect fMRI Repetition Suppression for Objects , 2013, The Journal of Neuroscience.

[20]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[21]  James B. Rowe,et al.  Different Neural Mechanisms within Occipitotemporal Cortex Underlie Repetition Suppression across Same and Different-Size Faces , 2012, Cerebral cortex.

[22]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[23]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[24]  Russell A. Epstein,et al.  The Parahippocampal Place Area Recognition, Navigation, or Encoding? , 1999, Neuron.

[25]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[26]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[27]  Wolfgang Prinz,et al.  Prospective coding in event representation , 2007, Cognitive Processing.

[28]  Scott T. Grafton,et al.  Wandering Minds: The Default Network and Stimulus-Independent Thought , 2007, Science.

[29]  R. Miall,et al.  Connecting mirror neurons and forward models. , 2003, Neuroreport.

[30]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[31]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[32]  D Yves von Cramon,et al.  Sequences of Abstract Nonbiological Stimuli Share Ventral Premotor Cortex with Action Observation and Imagery , 2004, The Journal of Neuroscience.

[33]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[34]  M. Goodale,et al.  Two visual systems re-viewed , 2008, Neuropsychologia.

[35]  Arne D. Ekstrom,et al.  Single-Neuron Responses in Humans during Execution and Observation of Actions , 2010, Current Biology.

[36]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[37]  Salvatore Maria Aglioti,et al.  The Sound of Actions in Apraxia , 2008, Current Biology.

[38]  S. Blakemore,et al.  Motor activation prior to observation of a predicted movement , 2004, Nature Neuroscience.

[39]  Michael J. Constantino,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008 .

[40]  Christian Keysers,et al.  Granger Causality Mapping during Joint Actions Reveals Evidence for Forward Models That Could Overcome Sensory-Motor Delays , 2010, PloS one.

[41]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[42]  C. Urgesi,et al.  Simulating the future of actions in the human corticospinal system. , 2010, Cerebral cortex.

[43]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[44]  Christian Keysers,et al.  Mapping the flow of information within the putative mirror neuron system during gesture observation , 2011, NeuroImage.

[45]  Andreas Bartels,et al.  fMRI and its interpretations: an illustration on directional selectivity in area V5/MT , 2008, Trends in Neurosciences.

[46]  Leonardo Fogassi,et al.  Mirror neurons in monkey area F5 do not adapt to the observation of repeated actions , 2013, Nature Communications.

[47]  Luciano Fadiga,et al.  The role of the motor system in discriminating normal and degraded speech sounds , 2012, Cortex.

[48]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[49]  Silvio Ionta,et al.  Virtual lesion of ventral premotor cortex impairs visual perception of biomechanically possible but not impossible actions , 2008, Social neuroscience.

[50]  R. Malach,et al.  Cortical hierarchy reflected in the organization of intrinsic connections in macaque monkey visual cortex , 1993, The Journal of comparative neurology.

[51]  T Shallice,et al.  A Form of Ideational Apraxia as a Delective Deficit of Contention Scheduling , 2001, Cognitive neuropsychology.

[52]  Y. Paulignan,et al.  An Interference Effect of Observed Biological Movement on Action , 2003, Current Biology.

[53]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[54]  Klaas E. Stephan,et al.  Dynamic causal modelling: A critical review of the biophysical and statistical foundations , 2011, NeuroImage.

[55]  C. Keysers,et al.  Empathy and the Somatotopic Auditory Mirror System in Humans , 2006, Current Biology.

[56]  J. Haxby,et al.  Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements , 2002, Neuron.

[57]  G. Rizzolatti,et al.  I Know What You Are Doing A Neurophysiological Study , 2001, Neuron.

[58]  Alice C. Roy,et al.  Encoding of human action in Broca's area. , 2009, Brain : a journal of neurology.

[59]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[60]  Atsushi Iriki,et al.  Social cognition in premotor and parietal cortex , 2008, Social neuroscience.

[61]  S. Aglioti,et al.  Neural Underpinnings of Gesture Discrimination in Patients with Limb Apraxia , 2008, The Journal of Neuroscience.

[62]  Antonia F. de C. Hamilton,et al.  Action Understanding Requires the Left Inferior Frontal Cortex , 2006, Current Biology.

[63]  U. Castiello,et al.  Cues to intention: The role of movement information , 2011, Cognition.

[64]  J. Marshall Mirror neurons , 2014, Proceedings of the National Academy of Sciences.

[65]  Alan C. Evans,et al.  Specific Involvement of Human Parietal Systems and the Amygdala in the Perception of Biological Motion , 1996, The Journal of Neuroscience.

[66]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[67]  Rufin Vogels,et al.  Stimulus repetition probability does not affect repetition suppression in macaque inferior temporal cortex. , 2011, Cerebral cortex.

[68]  Karl J. Friston,et al.  Evidence of Mirror Neurons in Human Inferior Frontal Gyrus , 2009, The Journal of Neuroscience.

[69]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[70]  G. Rizzolatti,et al.  Impairment of actions chains in autism and its possible role in intention understanding , 2007, Proceedings of the National Academy of Sciences.

[71]  K. Heilman,et al.  Pantomime agnosia. , 1986, Journal of neurology, neurosurgery, and psychiatry.

[72]  Christian Keysers,et al.  Mirror neurons , 2009, Current Biology.

[73]  Nikolaus Weiskopf,et al.  Dissociable roles of human inferior frontal gyrus during action execution and observation , 2012, NeuroImage.

[74]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[75]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[76]  L. Fogassi,et al.  Audiovisual mirror neurons and action recognition , 2003, Experimental Brain Research.

[77]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[78]  Klára Vicsi,et al.  FMRI repetition suppression for voices is modulated by stimulus expectations , 2013, NeuroImage.

[79]  G. Orban,et al.  Human Functional Magnetic Resonance Imaging Reveals Separation and Integration of Shape and Motion Cues in Biological Motion Processing , 2009, The Journal of Neuroscience.

[80]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[81]  R. Blake,et al.  Brain Areas Active during Visual Perception of Biological Motion , 2002, Neuron.

[82]  N. Kanwisher,et al.  fMRI Adaptation Reveals Mirror Neurons in Human Inferior Parietal Cortex , 2008, Current Biology.

[83]  R. Schubotz Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[84]  C. Keysers,et al.  Action Understanding : How , What and Why , 2022 .

[85]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[86]  Alexander Kraskov,et al.  Corticospinal Neurons in Macaque Ventral Premotor Cortex with Mirror Properties: A Potential Mechanism for Action Suppression? , 2009, Neuron.

[87]  Cosimo Urgesi,et al.  Compensatory plasticity in the action observation network: virtual lesions of STS enhance anticipatory simulation of seen actions. , 2013, Cerebral cortex.

[88]  H. Poizner,et al.  Progressive Ideomotor Apraxia - Evidence for a Selective Impairment of the Action Production System , 1995, Brain and Cognition.

[89]  Karl J. Friston,et al.  Ten simple rules for dynamic causal modeling , 2010, NeuroImage.

[90]  C. Keysers,et al.  The Observation and Execution of Actions Share Motor and Somatosensory Voxels in all Tested Subjects: Single-Subject Analyses of Unsmoothed fMRI Data , 2008, Cerebral cortex.

[91]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[92]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[93]  T. Allison,et al.  Brain Activity Evoked by the Perception of Human Walking: Controlling for Meaningful Coherent Motion , 2003, The Journal of Neuroscience.

[94]  Keysers Christian,et al.  The Empathic Brain , 2011 .

[95]  Umberto Castiello,et al.  Social grasping: From mirroring to mentalizing , 2012, NeuroImage.

[96]  Melvyn A Goodale,et al.  Action Insight: The Role of the Dorsal Stream in the Perception of Grasping , 2005, Neuron.

[97]  Rafael Malach,et al.  Targeting the functional properties of cortical neurons using fMR-adaptation , 2012, NeuroImage.

[98]  R. Cubelli,et al.  Cognition in Action: Testing a Model of Limb Apraxia , 2000, Brain and Cognition.

[99]  G. Rizzolatti,et al.  Functional Organization of Inferior Parietal Lobule Convexity in the Macaque Monkey: Electrophysiological Characterization of Motor, Sensory and Mirror Responses and Their Correlation with Cytoarchitectonic Areas , 2022 .

[100]  Ehud Zohary,et al.  Dissociation between Ventral and Dorsal fMRI Activation during Object and Action Recognition , 2005, Neuron.

[101]  Alfonso Caramazza,et al.  Asymmetric fMRI adaptation reveals no evidence for mirror neurons in humans , 2009, Proceedings of the National Academy of Sciences.

[102]  Karl J. Friston,et al.  Network discovery with large DCMs , 2013, NeuroImage.

[103]  R. Vogels,et al.  Functional differentiation of macaque visual temporal cortical neurons using a parametric action space. , 2009, Cerebral cortex.

[104]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[105]  Luca Turella,et al.  Mirror neurons in humans: Consisting or confounding evidence? , 2009, Brain and Language.

[106]  Alfonso Caramazza,et al.  The orchestration of the sensory-motor systems: Clues from Neuropsychology , 2005, Cognitive neuropsychology.

[107]  James M. Kilner,et al.  More than one pathway to action understanding , 2011, Trends in Cognitive Sciences.