A shared neural substrate for action verbs and observed actions in human posterior parietal cortex

A shared neural substrate for action verbs and visually observed actions suggests sensory-motor contributions to language meaning. High-level sensory and motor cortical areas are activated when processing the meaning of language, but it is unknown whether, and how, words share a neural substrate with corresponding sensorimotor representations. We recorded from single neurons in human posterior parietal cortex (PPC) while participants viewed action verbs and corresponding action videos from multiple views. We find that PPC neurons exhibit a common neural substrate for action verbs and observed actions. Further, videos were encoded with mixtures of invariant and idiosyncratic responses across views. Action verbs elicited selective responses from a fraction of these invariant and idiosyncratic neurons, without preference, thus associating with a statistical sampling of the diverse sensory representations related to the corresponding action concept. Controls indicated that the results are not the product of visual imagery or arbitrary learned associations. Our results suggest that language may activate the consolidated visual experience of the reader.

[1]  Marco Lanzilotto,et al.  Stable readout of observed actions from format-dependent activity of monkey’s anterior intraparietal neurons , 2020, Proceedings of the National Academy of Sciences.

[2]  Y. Miyashita Perirhinal circuits for memory processing , 2019, Nature Reviews Neuroscience.

[3]  Marco Lanzilotto,et al.  Anterior Intraparietal Area: A Hub in the Observed Manipulative Action Network , 2019, Cerebral cortex.

[4]  G. Orban,et al.  The role of putative human anterior intraparietal sulcus area in observed manipulative action discrimination , 2019, Brain and behavior.

[5]  Moritz F. Wurm,et al.  Distinct roles of temporal and frontoparietal cortex in representing actions across vision and language , 2019, Nature Communications.

[6]  Nader Pouratian,et al.  Single-Neuron Representation of Memory Strength and Recognition Confidence in Left Human Posterior Parietal Cortex , 2018, Neuron.

[7]  R. Andersen,et al.  Partially Mixed Selectivity in Human Posterior Parietal Association Cortex , 2017, Neuron.

[8]  Doris Y. Tsao,et al.  The Code for Facial Identity in the Primate Brain , 2017, Cell.

[9]  P. Weiss,et al.  Lesion evidence for a human mirror neuron system , 2017, Cortex.

[10]  T. Rogers,et al.  The neural and computational bases of semantic cognition , 2016, Nature Reviews Neuroscience.

[11]  Aimee E. Stahl,et al.  Individual differences in nonlinguistic event categorization predict later motion verb comprehension. , 2016, Journal of experimental child psychology.

[12]  Shannon M. Pruden,et al.  Prelinguistic foundations of verb learning: Infants discriminate and categorize dynamic human actions. , 2016, Journal of experimental child psychology.

[13]  David J. Freedman,et al.  Neuronal Mechanisms of Visual Categorization: An Abstract View on Decision Making. , 2016, Annual review of neuroscience.

[14]  Ha Hong,et al.  Explicit information for category-orthogonal object properties increases along the ventral stream , 2016, Nature Neuroscience.

[15]  Stefano Fusi,et al.  Why neurons mix: high dimensionality for higher cognition , 2016, Current Opinion in Neurobiology.

[16]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .

[17]  Guy A. Orban,et al.  The organization of the posterior parietal cortex devoted to upper limb actions: An fMRI study , 2015, Human brain mapping.

[18]  Alfonso Caramazza,et al.  The origin of word-related motor activity. , 2015, Cerebral cortex.

[19]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[20]  Moritz F. Wurm,et al.  Decoding Actions at Different Levels of Abstraction , 2015, The Journal of Neuroscience.

[21]  P. Downing,et al.  The lateral occipitotemporal cortex in action , 2015, Trends in Cognitive Sciences.

[22]  Alfonso Caramazza,et al.  Embodied cognition and mirror neurons: a critical assessment. , 2014, Annual review of neuroscience.

[23]  F. Pulvermüller How neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics , 2013, Trends in Cognitive Sciences.

[24]  Anjan Chatterjee,et al.  Action Concepts in the Brain: An Activation Likelihood Estimation Meta-analysis , 2013, Journal of Cognitive Neuroscience.

[25]  D. Tranel,et al.  Behavioral patterns and lesion sites associated with impaired processing of lexical and conceptual knowledge of actions , 2012, Cortex.

[26]  Paul E. Downing,et al.  Viewpoint (In)dependence of Action Representations: An MVPA Study , 2012, Journal of Cognitive Neuroscience.

[27]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[28]  G. Rizzolatti,et al.  View-Based Encoding of Actions in Mirror Neurons of Area F5 in Macaque Premotor Cortex , 2011, Current Biology.

[29]  Laurel J Buxbaum,et al.  Critical brain regions for action recognition: lesion symptom mapping in left hemisphere stroke. , 2010, Brain : a journal of neurology.

[30]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[31]  R. Andersen,et al.  Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits , 2009, Neuron.

[32]  A. Damasio,et al.  Convergence and divergence in a neural architecture for recognition and memory , 2009, Trends in Neurosciences.

[33]  L. Tyler,et al.  Modulation of motor and premotor cortices by actions, action words and action sentences , 2009, Neuropsychologia.

[34]  Philippe Kahane,et al.  Cortical dynamics of word recognition , 2008, Human brain mapping.

[35]  Kathy Hirsh-Pasek,et al.  Imageability predicts the age of acquisition of verbs in Chinese children* , 2008, Journal of Child Language.

[36]  Kathy Hirsh-Pasek,et al.  How toddlers begin to learn verbs , 2008, Trends in Cognitive Sciences.

[37]  Mutsumi Imai,et al.  Novel noun and verb learning in Chinese-, English-, and Japanese-speaking children. , 2008, Child development.

[38]  Alfonso Caramazza,et al.  What is the role of motor simulation in action and object recognition? Evidence from apraxia , 2007, Cognitive neuropsychology.

[39]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[40]  G. Rizzolatti,et al.  Congruent Embodied Representations for Visually Presented Actions and Linguistic Phrases Describing Actions , 2006, Current Biology.

[41]  M. Graziano The organization of behavioral repertoire in motor cortex. , 2006, Annual review of neuroscience.

[42]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[43]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[44]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[45]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[46]  Erminio Capitani,et al.  Apraxia is not associated to a disproportionate naming impairment for manipulable objects , 2003, Brain and Cognition.

[47]  H. Freund,et al.  Recognition and imitation of pantomimed motor acts after unilateral parietal and premotor lesions: a perspective on apraxia , 2001, Neuropsychologia.

[48]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[49]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[50]  Minami Ito,et al.  Size and position invariance of neuronal responses in monkey inferotemporal cortex. , 1995, Journal of neurophysiology.

[51]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[52]  J. Huttenlocher,et al.  Emergence of Action Categories in the Child: Evidence from Verb Meanings. , 1983 .