The specificity of action knowledge in sensory and motor systems

Neuroimaging studies have found that sensorimotor systems are engaged when participants observe actions or comprehend action language. However, most of these studies have asked the binary question of whether action concepts are embodied or not, rather than whether sensory and motor areas of the brain contain graded amounts of information during putative action simulations. To address this question, we used repetition suppression (RS) functional magnetic resonance imaging to determine if functionally-localized motor movement and visual motion regions-of-interest (ROI) and two anatomical ROIs (inferior frontal gyrus, IFG; left posterior middle temporal gyrus, pMTG) were sensitive to changes in the exemplar (e.g., two different people “kicking”) or representational format (e.g., photograph or schematic drawing of someone “kicking”) within pairs of action images. We also investigated whether concrete versus more symbolic depictions of actions (i.e., photographs or schematic drawings) yielded different patterns of activation throughout the brain. We found that during a conceptual task, sensory and motor systems represent actions at different levels of specificity. While the visual motion ROI did not exhibit RS to different exemplars of the same action or to the same action depicted by different formats, the motor movement ROI did. These effects are consistent with “person-specific” action simulations: if the motor system is recruited for action understanding, it does so by activating one's own motor program for an action. We also observed significant repetition enhancement within the IFG ROI to different exemplars or formats of the same action, a result that may indicate additional cognitive processing on these trials. Finally, we found that the recruitment of posterior brain regions by action concepts depends on the format of the input: left lateral occipital cortex and right supramarginal gyrus responded more strongly to symbolic depictions of actions than concrete ones.

[1]  Paul E. Downing,et al.  Representation of Action in Occipito-temporal Cortex , 2011, Journal of Cognitive Neuroscience.

[2]  P. Fletcher,et al.  Selecting among competing alternatives: selection and retrieval in the left inferior frontal gyrus. , 2005, Cerebral cortex.

[3]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[4]  Karl J. Friston,et al.  Evidence of Mirror Neurons in Human Inferior Frontal Gyrus , 2009, The Journal of Neuroscience.

[5]  J. Decety,et al.  The power of simulation: Imagining one's own and other's behavior , 2006, Brain Research.

[6]  Gereon R. Fink,et al.  Functional Interactions during the Retrieval of Conceptual Action Knowledge: An fMRI Study , 2007, Journal of Cognitive Neuroscience.

[7]  Lawrence W Barsalou,et al.  Abstraction in perceptual symbol systems. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  S. Thompson-Schill Neuroimaging studies of semantic memory: inferring “how” from “where” , 2003, Neuropsychologia.

[9]  Lisa Aziz-Zadeh,et al.  Embodied semantics for actions: Findings from functional brain imaging , 2008, Journal of Physiology-Paris.

[10]  V. Gallese,et al.  What is so special about embodied simulation? , 2011, Trends in Cognitive Sciences.

[11]  R. Buckner,et al.  Evidence for Neural Effects of Repetition that Directly Correlate with Behavioral Priming , 2004, Journal of Cognitive Neuroscience.

[12]  Karen Emmorey,et al.  Modulation of BOLD Response in Motion-sensitive Lateral Temporal Cortex by Real and Fictive Motion Sentences , 2010, Journal of Cognitive Neuroscience.

[13]  R. Henson Neuroimaging studies of priming , 2003, Progress in Neurobiology.

[14]  Christine E. Watson,et al.  The functional neuroanatomy of actions , 2011, Neurology.

[15]  Sian L. Beilock,et al.  Sports experience changes the neural processing of action language , 2008, Proceedings of the National Academy of Sciences.

[16]  Nancy Kanwisher,et al.  Divide and conquer: A defense of functional localizers , 2006, NeuroImage.

[17]  A. Luria,et al.  Disorders of "simultaneous perception" in a case of bilateral occipito-parietal brain injury. , 1959, Brain : a journal of neurology.

[18]  Patrick Morrison,et al.  The Symbolic Species: The Co-Evolution of Language and the Human Brain , 1999, BMJ.

[19]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[20]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[21]  P. Hagoort,et al.  The suppression of repetition enhancement: A review of fMRI studies , 2013, Neuropsychologia.

[22]  Nikolaus Weiskopf,et al.  Dissociable roles of human inferior frontal gyrus during action execution and observation , 2012, NeuroImage.

[23]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[24]  M. Garrett,et al.  Representing the meanings of object and action words: The featural and unitary semantic space hypothesis , 2004, Cognitive Psychology.

[25]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[26]  Roel M. Willems,et al.  Embodied Cognition: Taking the Next Step , 2012, Front. Psychology.

[27]  Harold Bekkering,et al.  Flexibility in embodied lexical‐semantic representations , 2012, Human brain mapping.

[28]  Anjan Chatterjee,et al.  Language and space: some interactions , 2001, Trends in Cognitive Sciences.

[29]  Alexander Kranjec,et al.  Schemas reveal spatial relations to a patient with simultanagnosia , 2013, Cortex.

[30]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[31]  Velia Cardin,et al.  Adaptation to heading direction dissociates the roles of human MST and V6 in the processing of optic flow. , 2012, Journal of neurophysiology.

[32]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[33]  Alan C. Evans,et al.  A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. , 2000, Cerebral cortex.

[34]  Wolf Singer,et al.  Feature-based attention affects direction-selective fMRI adaptation in hMT+. , 2013, Cerebral cortex.

[35]  Disorders of ' Simultaneous Perception ' ' Case of Bilateral Occipitoparietal Brain Injury , .

[36]  Sharon L. Thompson-Schill,et al.  Conceptual Representations of Action in the Lateral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[37]  T. Deacon The Symbolic Species: The Co-evolution of Language and the Brain , 1998 .

[38]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[39]  D. Plaut Graded modality-specific specialisation in semantics: A computational account of optic aphasia , 2002, Cognitive neuropsychology.

[40]  Anjan Chatterjee,et al.  Action Concepts in the Brain: An Activation Likelihood Estimation Meta-analysis , 2013, Journal of Cognitive Neuroscience.

[41]  R. Passingham,et al.  Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation , 2006, Current Biology.

[42]  Craig J. Brozinsky,et al.  Impact of Early Deafness and Early Exposure to Sign Language on the Cerebral Organization for Motion Processing , 2001, The Journal of Neuroscience.

[43]  D. Heeger,et al.  Retinotopy and Functional Subdivision of Human Areas MT and MST , 2002, The Journal of Neuroscience.

[44]  John A. Pyles,et al.  fMR-Adaptation Reveals Invariant Coding of Biological Motion on the Human STS , 2009, Front. Hum. Neurosci..

[45]  L. Tyler,et al.  Modulation of motor and premotor cortices by actions, action words and action sentences , 2009, Neuropsychologia.

[46]  Thomas E. Nichols,et al.  Controlling the familywise error rate in functional neuroimaging: a comparative review , 2003, Statistical methods in medical research.

[47]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[48]  D. Greve,et al.  Task and semantic relationship influence both the polarity and localization of hemodynamic modulation during lexico‐semantic processing , 2008, Human brain mapping.

[49]  Michael K. Tanenhaus,et al.  Neural correlates of partial lexical activation , 2008, Proceedings of the National Academy of Sciences.

[50]  G. Pezzulo,et al.  When affordances climb into your mind: Advantages of motor simulation in a memory task performed by novice and expert rock climbers , 2010, Brain and Cognition.

[51]  Silvia P. Gennari Representing Motion in Language Comprehension: Lessons From Neuroimaging , 2012, Lang. Linguistics Compass.

[52]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[53]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[54]  A. Chatterjee Disembodying cognition , 2010, Language and Cognition.

[55]  K. Grill-Spector,et al.  fMR-adaptation: a tool for studying the functional properties of human cortical neurons. , 2001, Acta psychologica.

[56]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[57]  C. Peirce,et al.  Philosophical Writings of Peirce , 1955 .

[58]  Angelika Lingnau,et al.  Speed encoding in human visual cortex revealed by fMRI adaptation. , 2009, Journal of vision.

[59]  W. Umbreit V – Specificity of Action , 1954 .

[60]  A. Damasio,et al.  Neural Correlates of Naming Actions and of Naming Spatial Relations , 2001, NeuroImage.

[61]  Laurel J Buxbaum,et al.  Critical brain regions for action recognition: lesion symptom mapping in left hemisphere stroke. , 2010, Brain : a journal of neurology.

[62]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[63]  L. Tyler,et al.  Repetition suppression and semantic enhancement: An investigation of the neural correlates of priming , 2006, Neuropsychologia.

[64]  Angelika Lingnau,et al.  Selective visual responses to expansion and rotation in the human MT complex revealed by functional magnetic resonance imaging adaptation , 2008, The European journal of neuroscience.

[65]  Daniel Y. Kimberg,et al.  Language, perception, and the schematic representation of spatial relations , 2012, Brain and Language.

[66]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[67]  A. Chatterjee The neural organization of spatial thought and language. , 2008, Seminars in speech and language.

[68]  Anjan Chatterjee,et al.  Specificity of Action Representations in the Lateral Occipitotemporal Cortex , 2006, Journal of Cognitive Neuroscience.

[69]  J. Kable,et al.  Neural Substrates of Action Event Knowledge , 2002, Journal of Cognitive Neuroscience.