RP and N400 ERP components reflect semantic violations in visual processing of human actions

Event-related brain potentials (ERPs) were used to investigate the visual processing of actions belonging to the typical human repertoire. Two hundred and sixty coloured pictures representing persons differing in number, age and gender, engaged in simple actions, were presented to 23 right-handed students. Perception of meaningful actions (e.g., young woman trying shoes in shop) was contrasted with perception of actions lacking an understandable goal (e.g., businesswoman balancing on one foot in desert). The results indicated early recognition of comprehensible behaviour in the form of an enhanced posterior "recognition potential" (RP) (N250), which was followed by a larger negativity (N400) in response to incongruent actions. The results suggest that incoming visual information regarding human gestures is processed similarly to linguistic inputs from a conceptual point of view, thus eliciting a posterior RP when the action code is visually recognized and comprehended, and a later N400 when the action is not recognized or is difficult to integrate with previous knowledge.

[1]  G. Houghton,et al.  ERP analyses of task effects on semantic processing from words. , 2005, Brain research. Cognitive brain research.

[2]  A. Proverbio,et al.  When neurons do not mirror the agent's intentions: Sex differences in neural coding of goal-directed actions , 2010, Neuropsychologia.

[3]  A P Rudell,et al.  The recognition potential, word difficulty, and individual reading ability: on using event-related potentials to study perception. , 1997, Journal of experimental psychology. Human perception and performance.

[4]  F. Rubia,et al.  Functional differences in the semantic processing of concrete and abstract words , 2001, Neuropsychologia.

[5]  J. Hinojosa,et al.  Electrophysiological evidence of an early effect of sentence context in reading , 2004, Biological Psychology.

[6]  The recognition potential and the word frequency effect at a high rate of word presentation. , 1999, Brain research. Cognitive brain research.

[7]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[8]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[9]  Alice Mado Proverbio,et al.  Language switching mechanisms in simultaneous interpreters: an ERP study , 2004, Neuropsychologia.

[10]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[11]  M. Kutas,et al.  The N400 in a semantic categorization task across 6 decades. , 1998, Electroencephalography and clinical neurophysiology.

[12]  C. Petten,et al.  A special role for the right hemisphere in metaphor comprehension? ERP evidence from hemifield presentation , 2007, Brain Research.

[13]  J A Hinojosa,et al.  Semantic processing of open- and closed-class words: an event-related potentials study. , 2001, Brain research. Cognitive brain research.

[14]  L. Aravind,et al.  Integration of Word Meaning and World Knowledge in Language Comprehension , 2022 .

[15]  D. Perrett,et al.  A region of right posterior superior temporal sulcus responds to observed intentional actions , 2004, Neuropsychologia.

[16]  U. Bellugi,et al.  Neural Systems Mediating American Sign Language: Effects of Sensory Experience and Age of Acquisition , 1997, Brain and Language.

[17]  Michael J Cortese,et al.  Handbook of Psycholinguistics , 2011 .

[18]  Peter Hagoort,et al.  The Processing Nature of the N400: Evidence from Masked Priming , 1993, Journal of Cognitive Neuroscience.

[19]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[20]  Frank E. Pollick,et al.  Neural Substrates for Action Understanding at Different Description Levels in the Human Brain , 2008, Journal of Cognitive Neuroscience.

[21]  Miguel A. Pozo,et al.  Electrophysiological evidence of automatic early semantic processing , 2004, Brain and Language.

[22]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Scott T. Grafton,et al.  Action outcomes are represented in human inferior frontoparietal cortex. , 2008, Cerebral cortex.

[24]  M. Iacoboni.  Neural mechanisms of imitation , 2005, Current Opinion in Neurobiology.

[25]  R. Adorni,et al.  Inferring native language from early bio-electrical activity , 2009, Biological Psychology.

[26]  Marta Kutas,et al.  Neural plasticity in the dynamics of human visual word recognition , 1998, Neuroscience Letters.

[27]  M. Kutas,et al.  Event-related brain potentials to grammatical errors and semantic anomalies , 1983, Memory & cognition.

[28]  H. Neville,et al.  Fractionating language: different neural subsystems with different sensitive periods. , 1992, Cerebral cortex.

[29]  R. Adorni,et al.  The left fusiform area is affected by written frequency of words , 2008, Neuropsychologia.

[30]  D. Tucker,et al.  Parametric analysis of event-related potentials in semantic comprehension: evidence for parallel brain mechanisms. , 2003, Brain research. Cognitive brain research.

[31]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: I. Intracranial distribution and neural generators , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  Kevin A. Pelphrey,et al.  Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception , 2004, Journal of Cognitive Neuroscience.

[33]  R. Leiguarda,et al.  The neural substrate of gesture recognition , 2008, Neuropsychologia.

[34]  Manuel Martín-Loeches,et al.  The gate for reading: Reflections on the recognition potential , 2007, Brain Research Reviews.