Where and how our brain represents the temporal structure of observed action

Reacting faster to the behavior of others provides evolutionary advantages. Reacting to unpredictable events takes hundreds of milliseconds. Understanding where and how the brain represents what actions are likely to follow one another is therefore important. Everyday actions are predictable sequences of acts, yet neuroscientists focus on how brains responds to unexpected, individual motor acts. Using fMRI we show the brain encodes sequence-specific information in the motor system. Using EEG, we show visual responses were faster and smaller for predictable sequences that recruit the motor system. This study shifts the study of action observation from single acts to motor sequences, informs how we adapt to the actions of others and suggests the motor system may implement perceptual predictive coding.

[1]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[2]  G. Orban,et al.  Action Observation Circuits in the Macaque Monkey Cortex , 2011, The Journal of Neuroscience.

[3]  Douglas Cheyne,et al.  Dissociating Two Stages of Preparation in the Stop Signal Task Using fMRI , 2015, PloS one.

[4]  Julien Doyon,et al.  Functional neuroanatomical networks associated with expertise in motor imagery , 2008, NeuroImage.

[5]  Alison J. Wiggett,et al.  Surface-Based Information Mapping Reveals Crossmodal Vision–Action Representations in Human Parietal and Occipitotemporal Cortex , 2010, Journal of neurophysiology.

[6]  J. Mazziotta,et al.  Grasping the Intentions of Others with One's Own Mirror Neuron System , 2005, PLoS biology.

[7]  C. Keysers,et al.  Hebbian learning and predictive mirror neurons for actions, sensations and emotions , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  J. Schoffelen,et al.  Nonparametric statistical testing of coherence differences , 2007, Journal of Neuroscience Methods.

[9]  Scott T. Grafton,et al.  Evidence for a distributed hierarchy of action representation in the brain. , 2007, Human movement science.

[10]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[11]  John Jonides,et al.  Frontal–Medial Temporal Interactions Mediate Transitions among Representational States in Short-Term Memory , 2014, The Journal of Neuroscience.

[12]  G. Rizzolatti,et al.  I Know What You Are Doing A Neurophysiological Study , 2001, Neuron.

[13]  D Yves von Cramon,et al.  Motor areas beyond motor performance: deficits in serial prediction following ventrolateral premotor lesions. , 2004, Neuropsychology.

[14]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[15]  C. Keysers,et al.  μ-Suppression during Action Observation and Execution Correlates with BOLD in Dorsal Premotor, Inferior Parietal, and SI Cortices , 2011, The Journal of Neuroscience.

[16]  C. Frith,et al.  Action Observation: Inferring Intentions without Mirror Neurons , 2008, Current Biology.

[17]  L. Vaina,et al.  Neural systems underlying learning and representation of global motion. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Christian Keysers,et al.  Expanding the mirror: vicarious activity for actions, emotions, and sensations , 2009, Current Opinion in Neurobiology.

[19]  B. Abernethy,et al.  Cortical fMRI activation to opponents’ body kinematics in sport-related anticipation: Expert-novice differences with normal and point-light video , 2011, Neuroscience Letters.

[20]  C. Keysers,et al.  The Observation and Execution of Actions Share Motor and Somatosensory Voxels in all Tested Subjects: Single-Subject Analyses of Unsmoothed fMRI Data , 2008, Cerebral cortex.

[21]  Christian Keysers,et al.  Testing Simulation Theory with Cross-Modal Multivariate Classification of fMRI Data , 2008, PloS one.

[22]  C. Keysers,et al.  Integrating simulation and theory of mind: from self to social cognition , 2007, Trends in Cognitive Sciences.

[23]  Alfonso Caramazza,et al.  Embodied cognition and mirror neurons: a critical assessment. , 2014, Annual review of neuroscience.

[24]  S. Bengtsson,et al.  Impact of Feedback on Three Phases of Performance Monitoring , 2013, Experimental psychology.

[25]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[26]  Mizuki Ihara,et al.  Ongoing Activity in Temporally Coherent Networks Predicts Intra-Subject Fluctuation of Response Time to Sporadic Executive Control Demands , 2014, PloS one.

[27]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[28]  L. Fogassi,et al.  Audiovisual mirror neurons and action recognition , 2003, Experimental Brain Research.

[29]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[30]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[31]  D. V. von Cramon,et al.  Interval and ordinal properties of sequences are associated with distinct premotor areas. , 2001, Cerebral cortex.

[32]  C. Fiebach,et al.  Dynamic Anticipatory Processing of Hierarchical Sequential Events: a Common Role for Broca's Area and Ventral Premotor Cortex Across Domains? , 2006, Cortex.

[33]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[34]  Mikko Sams,et al.  Inter-Subject Correlation of Brain Hemodynamic Responses During Watching a Movie: Localization in Space and Frequency , 2009, Front. Neuroinform..

[35]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[36]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[37]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[38]  C. Keysers,et al.  Action Understanding : How , What and Why , 2022 .

[39]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[40]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[41]  J C Mazziotta,et al.  Reafferent copies of imitated actions in the right superior temporal cortex , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[42]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[43]  M. Brass,et al.  Investigating Action Understanding: Inferential Processes versus Action Simulation , 2007, Current Biology.

[44]  R. Mar The neural bases of social cognition and story comprehension. , 2011, Annual review of psychology.