Time to Tango: Expertise and contextual anticipation during action observation

Predictive theories of action observation propose that we use our own motor system as a guide for anticipating and understanding other people's actions through the generation of context-based expectations. According to this view, people should be better in predicting and interpreting those actions that are present in their own motor repertoire compared to those that are not. We recorded high-density event-related potentials (ERPs: P300, N400 and Slow Wave, SW) and source estimation in 80 subjects separated by their level of expertise (experts, beginners and naïves) as they observed realistic videos of Tango steps with different degrees of execution correctness. We also performed path analysis to infer causal relationships between ongoing anticipatory brain activity, evoked semantic responses, expertise measures and behavioral performance. We found that anticipatory activity, with sources in a fronto-parieto-occipital network, early discriminated between groups according to their level of expertise. Furthermore, this early activity significantly predicted subsequent semantic integration indexed by semantic responses (N400 and SW, sourced in temporal and motor regions) which also predicted motor expertise. In addition, motor expertise was a good predictor of behavioral performance. Our results show that neural and temporal dynamics underlying contextual action anticipation and comprehension can be interpreted in terms of successive levels of contextual prediction that are significantly modulated by subject's prior experience.

[1]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[2]  R. Kliegl,et al.  Human Microsaccade-Related Visual Brain Responses , 2009, The Journal of Neuroscience.

[3]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[4]  Alan Garnham,et al.  Switching Modalities in A Sentence Verification Task: ERP Evidence for Embodied Language Processing , 2011, Front. Psychology.

[5]  A. Ibanez,et al.  Motor-language coupling: Direct evidence from early Parkinson’s disease and intracranial cortical recordings , 2013, Cortex.

[6]  Seana Coulson,et al.  Modality Switching in a Property Verification Task: An ERP Study of What Happens When Candles Flicker after High Heels Click , 2011, Front. Psychology.

[7]  Frank E. Pollick,et al.  Motor Simulation without Motor Expertise: Enhanced Corticospinal Excitability in Visually Experienced Dance Spectators , 2012, PloS one.

[8]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. I. Superior temporal plane and parietal lobe. , 1995, Electroencephalography and clinical neurophysiology.

[9]  Franco Simonetti,et al.  Gesture and metaphor comprehension: Electrophysiological evidence of cross-modal coordination by audiovisual stimulation , 2009, Brain and Cognition.

[10]  R. P. McDonald,et al.  Principles and practice in reporting structural equation analyses. , 2002, Psychological methods.

[11]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 1. Depth recorded potentials in the human occipital and parietal lobes , 1994, Journal of Physiology-Paris.

[12]  Brian S. Schnitzer,et al.  Eye movements and attention: The role of pre-saccadic shifts of attention in perception, memory and the control of saccades , 2012, Vision Research.

[13]  Giosuè Baggio,et al.  The balance between memory and unification in semantics: A dynamic account of the N400 , 2011 .

[14]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. III. Frontal cortex. , 1995, Electroencephalography and clinical neurophysiology.

[15]  Facundo Manes,et al.  High contextual sensitivity of metaphorical expressions and gesture blending: A video event-related potential design , 2011, Psychiatry Research: Neuroimaging.

[16]  Bill Shipley,et al.  Cause and Correlation in Biology: A User''s Guide to Path Analysis , 2016 .

[17]  M. Raichle Two views of brain function , 2010, Trends in Cognitive Sciences.

[18]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[19]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[20]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[21]  Barbara M. Byrne,et al.  Structural equation modeling with AMOS , 2010 .

[22]  M. Heil,et al.  Expertise in dance modulates alpha/beta event‐related desynchronization during action observation , 2008, The European journal of neuroscience.

[23]  F. Manes,et al.  N400 ERPs for actions: building meaning in context , 2013, Front. Hum. Neurosci..

[24]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[25]  A. Nakamura,et al.  Localizing the distributed language network responsible for the N400 measured by MEG during auditory sentence processing , 2006, Brain Research.

[26]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[27]  S. Kochen,et al.  Expectation and Attention in Hierarchical Auditory Prediction , 2013, The Journal of Neuroscience.

[28]  P. Sinha,et al.  Functional neuroanatomy of biological motion perception in humans , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[30]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[31]  J J Riera,et al.  Evaluation of inverse methods and head models for EEG source localization using a human skull phantom , 2001, Physics in medicine and biology.

[32]  Cosimo Urgesi,et al.  Long- and short-term plastic modeling of action prediction abilities in volleyball , 2011, Psychological Research.

[33]  J. Eccles The actions of antidromic impulses on ganglion cells , 1936, The Journal of physiology.

[34]  P. Haggard,et al.  Extrastriate body area underlies aesthetic evaluation of body stimuli , 2010, Experimental Brain Research.

[35]  George R. Franke,et al.  Structural Equation Modeling with EQS and EQS/Windows , 1995 .

[36]  G. Rizzolatti,et al.  Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study , 2004, Journal of Cognitive Neuroscience.

[37]  E Donchin,et al.  P300 and stimulus categorization: two plus one is not so different from one plus one. , 1980, Psychophysiology.

[38]  R. Buckner,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.2 Self-projection and the brain , 2022 .

[39]  E. Halgren,et al.  Generators of the late cognitive potentials in auditory and visual oddball tasks. , 1998, Electroencephalography and clinical neurophysiology.

[40]  P. Haggard,et al.  Experts see it all: configural effects in action observation , 2010, Psychological research.

[41]  D. Chwilla,et al.  The Relationship of Language and Emotion: N400 Support for an Embodied View of Language Comprehension , 2011, Journal of Cognitive Neuroscience.

[42]  Olivia S. Cheung,et al.  Visual prediction and perceptual expertise. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[43]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[44]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Daniel Fraiman,et al.  Biological Motion Coding in the Brain: Analysis of Visually Driven EEG Functional Networks , 2014, PloS one.

[46]  J Peter Rosenfeld,et al.  Subjective and objective probability effects on P300 amplitude revisited. , 2005, Psychophysiology.

[47]  Daniele Schön,et al.  Cerebral Cortex doi:10.1093/cercor/bhr022 Musical Expertise Boosts Implicit Learning of Both Musical and Linguistic Structures , 2011 .

[48]  Dorothee J. Chwilla,et al.  Immediate integration of novel meanings: N400 support for an embodied view of language comprehension , 2007, Brain Research.

[49]  M. Corbetta,et al.  Extrastriate body area in human occipital cortex responds to the performance of motor actions , 2004, Nature Neuroscience.

[50]  James M. Kilner,et al.  More than one pathway to action understanding , 2011, Trends in Cognitive Sciences.

[51]  Vladimir López,et al.  ERPs and contextual semantic discrimination: Degrees of congruence in wakefulness and sleep , 2006, Brain and Language.

[52]  Cosimo Urgesi,et al.  Understanding 'what' others do: mirror mechanisms play a crucial role in action perception. , 2011, Social cognitive and affective neuroscience.

[53]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[54]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: I. Intracranial distribution and neural generators , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  Lucía Amoruso,et al.  Beyond Extrastriate Body Area (EBA) and Fusiform Body Area (FBA): Context Integration in the Meaning of Actions , 2011, Front. Hum. Neurosci..

[56]  Rodrigo Ortega,et al.  From neural signatures of emotional modulation to social cognition: individual differences in healthy volunteers and psychiatric participants. , 2014, Social cognitive and affective neuroscience.

[57]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[58]  Alice Mado Proverbio,et al.  RP and N400 ERP components reflect semantic violations in visual processing of human actions , 2009, Neuroscience Letters.

[59]  R. Adorni,et al.  Who needs a referee? How incorrect basketball actions are automatically detected by basketball players' brain , 2012, Scientific Reports.

[60]  Werner Sommer,et al.  Individual Differences in Face Cognition: Brain–Behavior Relationships , 2010, Journal of Cognitive Neuroscience.

[61]  M. Seghier The Angular Gyrus , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[62]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[63]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[64]  Michael J. Martinez,et al.  Cerebral Cortex doi:10.1093/cercor/bhj057 Cerebral Cortex Advance Access published October 12, 2005 The Neural Basis of Human Dance , 2022 .

[65]  Margherita Melloni,et al.  Empathy and contextual social cognition , 2014, Cognitive, affective & behavioral neuroscience.

[66]  Jason S. Sherfey,et al.  Sequential temporo‐fronto‐temporal activation during monitoring of the auditory environment for temporal patterns , 2011, Human brain mapping.

[67]  Moshe Bar,et al.  The proactive brain: memory for predictions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[68]  B. Byrne Book Review: Structural Equation Modeling with EQS and EQS/Windows: Basic Concepts, Applications, and Programming , 1994 .

[69]  S. Luck An Introduction to the Event-Related Potential Technique , 2005 .

[70]  E Macaluso,et al.  Action anticipation beyond the action observation network: a functional magnetic resonance imaging study in expert basketball players , 2012, The European journal of neuroscience.

[71]  C. Van Petten,et al.  Prediction during language comprehension: benefits, costs, and ERP components. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[72]  Gregory R. Hancock,et al.  BEST PRACTICES IN STRUCTURAL EQUATION MODELING , 2007 .

[73]  Barbara M. Byrne,et al.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[74]  D. Oathes,et al.  Dissecting the anticipation of aversion reveals dissociable neural networks. , 2013, Cerebral cortex.

[75]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[76]  Ying Choon Wu,et al.  Meaningful gestures: electrophysiological indices of iconic gesture comprehension. , 2005, Psychophysiology.

[77]  P. Jurák,et al.  The role of frontal and temporal lobes in visual discrimination task — depth ERP studies , 1999, Neurophysiologie Clinique/Clinical Neurophysiology.

[78]  Giuseppe De Arcangelis,et al.  Structural equations with latent variables, kenneth a. bollen. john wiley & sons, inc., new york, chichester, brisbane, toronto, singapore, 1989, isbn 0-471-01171-1, £39.90 hardbound, pp. xiv + 514 , 1993 .

[79]  Natalia Trujillo,et al.  Gesture influences the processing of figurative language in non-native speakers: ERP evidence , 2010, Neuroscience Letters.

[80]  Théodore Papadopoulo,et al.  OpenMEEG: opensource software for quasistatic bioelectromagnetics , 2010, Biomedical engineering online.

[81]  Lynne E. Bernstein,et al.  Spatiotemporal dynamics of audiovisual speech processing , 2008, NeuroImage.

[82]  Edward T. Bullmore,et al.  A direct demonstration of functional specialization within motion-related visual and auditory cortex of the human brain , 1996, Current Biology.

[83]  C. Stein,et al.  Structural equation modeling. , 2012, Methods in molecular biology.

[84]  Facundo Manes,et al.  Contextual social cognition and the behavioral variant of frontotemporal dementia , 2012, Neurology.

[85]  Karl J. Friston,et al.  Prediction, perception and agency , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[86]  A. Proverbio,et al.  When neurons do not mirror the agent's intentions: Sex differences in neural coding of goal-directed actions , 2010, Neuropsychologia.

[87]  Karl J. Friston,et al.  Evidence of Mirror Neurons in Human Inferior Frontal Gyrus , 2009, The Journal of Neuroscience.

[88]  M. Candidi,et al.  Representation of body identity and body actions in extrastriate body area and ventral premotor cortex , 2007, Nature Neuroscience.

[89]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. I. Depth-recorded potentials in the human occipital, temporal and parietal lobes [corrected]. , 1994, Journal of physiology, Paris.

[90]  Luc H. Arnal,et al.  Cortical oscillations and sensory predictions , 2012, Trends in Cognitive Sciences.

[91]  Alice Mado Proverbio,et al.  Observation of Static Pictures of Dynamic Actions Enhances the Activity of Movement-Related Brain Areas , 2009, PloS one.

[92]  S. Blakemore,et al.  Motor activation prior to observation of a predicted movement , 2004, Nature Neuroscience.

[93]  H. Damasio,et al.  Understanding otherness: the neural bases of action comprehension and pain empathy in a congenital amputee. , 2012, Cerebral cortex.

[94]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[95]  M. Besson,et al.  AN EVENT-RELATED POTENTIAL (ERP) STUDY OF MUSICAL EXPECTANCY : COMPARISON OF MUSICIANS WITH NONMUSICIANS , 1995 .

[96]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[97]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[98]  R. Salmelin,et al.  Distinct time courses of word and context comprehension in the left temporal cortex. , 1998, Brain : a journal of neurology.

[99]  Roel M. Willems,et al.  Complementary Systems for Understanding Action Intentions , 2008, Current Biology.

[100]  B. Oken,et al.  Statistical issues concerning computerized analysis of brainwave topography , 1986, Annals of neurology.

[101]  Phillip J Holcomb,et al.  Semantic integration in videos of real-world events: an electrophysiological investigation. , 2003, Psychophysiology.

[102]  T. Sejnowski,et al.  Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion , 2007, The Journal of Neuroscience.

[103]  Paola Cesari,et al.  Fooling the kickers but not the goalkeepers: behavioral and neurophysiological correlates of fake action detection in soccer. , 2013, Cerebral cortex.

[104]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[105]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[106]  Pablo López,et al.  INECO Frontal Screening (IFS): A brief, sensitive, and specific tool to assess executive functions in dementia–CORRECTED VERSION , 2009, Journal of the International Neuropsychological Society.

[107]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[108]  Heikki Lyytinen,et al.  Cortical Activation during Spoken-Word Segmentation in Nonreading-Impaired and Dyslexic Adults , 2002, The Journal of Neuroscience.

[109]  Hans-Jochen Heinze,et al.  Brain potentials and syntactic violations revisited: no evidence for specificity of the syntactic positive shift , 1998, Neuropsychologia.

[110]  R. Passingham,et al.  Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation , 2006, Current Biology.

[111]  David Huepe,et al.  What event-related potentials (ERPs) bring to social neuroscience? , 2012, Social neuroscience.

[112]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[113]  R. Saxe Against simulation: the argument from error , 2005, Trends in Cognitive Sciences.

[114]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[115]  B. Byrne,et al.  Structural Equation Modeling with EQS and EQS/Windows. , 1996 .

[116]  James M. Wilce Language and Emotion: The relationship of language and emotion , 2009 .