Robotic movement preferentially engages the action observation network

As humans, we gather a wide range of information about other people from watching them move. A network of parietal, premotor, and occipitotemporal regions within the human brain, termed the action observation network (AON), has been implicated in understanding others' actions by means of an automatic matching process that links observed and performed actions. Current views of the AON assume a matching process biased towards familiar actions; specifically, those performed by conspecifics and present in the observer's motor repertoire. In this study, we test how this network responds to form and motion cues when observing natural human motion compared to rigid robotic‐like motion across two independent functional neuroimaging experiments. In Experiment 1, we report the surprising finding that premotor, parietal, occipitotemporal regions respond more robustly to rigid, robot‐like motion than natural human motion. In Experiment 2, we replicate and extend this finding by demonstrating that the same pattern of results emerges whether the agent is a human or a robot, which suggests the preferential response to robot‐like motion is independent of the agent's form. These data challenge previous ideas about AON function by demonstrating that the core nodes of this network can be flexibly engaged by novel, unfamiliar actions performed by both human and non‐human agents. As such, these findings suggest that the AON is sensitive to a broader range of action features beyond those that are simply familiar. Hum Brain Mapp 33:2238–2254, 2012. © 2011 Wiley Periodicals, Inc.

[1]  D. Spalding The Principles of Psychology , 1873, Nature.

[2]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[3]  W. Prinz,et al.  Relationships Between Perception and Action: Current Approaches , 1990 .

[4]  W. Prinz A common-coding approach to perception and action , 1990 .

[5]  A F Bobick,et al.  Movement, activity and action: the role of knowledge in the perception of motion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  G. Orban,et al.  The kinetic occipital (KO) region in man: an fMRI study. , 1997, Cerebral cortex.

[7]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[8]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[9]  W. Prinz,et al.  Movement observation affects movement execution in a simple response task. , 2001, Acta psychologica.

[10]  Barbara Tversky,et al.  A Parametric Study of Mental Spatial Transformations of Bodies , 2002, NeuroImage.

[11]  Jessica A. Sommerville,et al.  Shared representations between self and other: a social cognitive neuroscience view , 2003, Trends in Cognitive Sciences.

[12]  Y. Paulignan,et al.  An Interference Effect of Observed Biological Movement on Action , 2003, Current Biology.

[13]  G. Rizzolatti,et al.  A unifying view of the basis of social cognition , 2004, Trends in Cognitive Sciences.

[14]  G. Rizzolatti,et al.  Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study , 2004, Journal of Cognitive Neuroscience.

[15]  U. Castiello,et al.  The Human Premotor Cortex Is 'Mirror' Only for Biological Actions , 2004, Current Biology.

[16]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[17]  T. Chaminade,et al.  Motor interference between Humans and Humanoid Robots: Effect of Biological and Artificial Motion , 2005, Proceedings. The 4nd International Conference on Development and Learning, 2005..

[18]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[19]  Peter Kirsch,et al.  Differential activation of pre-SMA and SMA proper during action observation: Effects of instructions , 2005, NeuroImage.

[20]  Joseph P. McCleery,et al.  EEG evidence for mirror neuron dysfunction in autism spectrum disorders. , 2005, Brain research. Cognitive brain research.

[21]  Gian Luca Romani,et al.  Neural systems underlying observation of humanly impossible movements: an FMRI study. , 2005, Cerebral cortex.

[22]  Alexander Münchau,et al.  Investigating the human mirror neuron system by means of cortical synchronization during the imitation of biological movements , 2006, NeuroImage.

[23]  Jennifer H. Pfeifer,et al.  Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders , 2006, Nature Neuroscience.

[24]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[25]  Andrew N. Meltzoff,et al.  Neural circuits involved in imitation and perspective-taking , 2006, NeuroImage.

[26]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[27]  M. Brass,et al.  Investigating Action Understanding: Inferential Processes versus Action Simulation , 2007, Current Biology.

[28]  R. Schubotz Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[29]  V. Gallese Embodied simulation: from mirror neuron systems to interpersonal relations. , 2007, Novartis Foundation symposium.

[30]  P. Downing,et al.  The neural basis of visual body perception , 2007, Nature Reviews Neuroscience.

[31]  Christian Keysers,et al.  The anthropomorphic brain: The mirror neuron system responds to human and robotic actions , 2007, NeuroImage.

[32]  W. N. Schoenfeld,et al.  Principles of Psychology , 2007 .

[33]  Karl J. Friston,et al.  The mirror-neuron system: a Bayesian perspective. , 2007, Neuroreport.

[34]  A. Meltzoff 'Like me': a foundation for social cognition. , 2007, Developmental science.

[35]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[36]  A. Hamilton,et al.  Interference effect of observed human movement on action is due to velocity profile of biological motion , 2007, Social neuroscience.

[37]  Katja Fiehler,et al.  How moving objects become animated: The human mirror neuron system assimilates non-biological movement patterns , 2008, Social neuroscience.

[38]  Roel M. Willems,et al.  Complementary Systems for Understanding Action Intentions , 2008, Current Biology.

[39]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[40]  R. Miall,et al.  Movement interference in autism-spectrum disorder , 2008, Neuropsychologia.

[41]  Jason B. Mattingley,et al.  Selective attention modulates inferior frontal gyrus activity during action observation , 2008, NeuroImage.

[42]  Marcel Brass,et al.  How do we infer others' goals from non-stereotypic actions? The outcome of context-sensitive inferential processing in right inferior parietal and posterior temporal cortex , 2008, NeuroImage.

[43]  Emily S. Cross,et al.  Sensitivity of the action observation network to physical and observational learning. , 2008, Cerebral cortex.

[44]  Marcel Brass,et al.  Contextual movement constraints of others modulate motor preparation in the observer , 2009, Neuropsychologia.

[45]  Karl J. Friston,et al.  Evidence of Mirror Neurons in Human Inferior Frontal Gyrus , 2009, The Journal of Neuroscience.

[46]  J. Roll,et al.  Where is your shoulder? Neural correlates of localizing others’ body parts , 2009, Neuropsychologia.

[47]  Takeo Watanabe,et al.  3D surface perception from motion involves a temporal–parietal network , 2009, The European journal of neuroscience.

[48]  C. Keysers,et al.  The Observation and Execution of Actions Share Motor and Somatosensory Voxels in all Tested Subjects: Single-Subject Analyses of Unsmoothed fMRI Data , 2008, Cerebral cortex.

[49]  Emily S. Cross,et al.  Dissociable substrates for body motion and physical experience in the human action observation network , 2009, The European journal of neuroscience.

[50]  Alison J. Wiggett,et al.  Surface-Based Information Mapping Reveals Crossmodal Vision–Action Representations in Human Parietal and Occipitotemporal Cortex , 2010, Journal of neurophysiology.

[51]  G. Rizzolatti,et al.  Brain Response to a Humanoid Robot in Areas Implicated in the Perception of Human Emotional Gestures , 2010, PloS one.

[52]  James M Kilner,et al.  What is simulated in the action observation network when we observe actions? , 2010, The European journal of neuroscience.

[53]  Wolfgang Prinz,et al.  When do we simulate non-human agents? Dissociating communicative and non-communicative actions , 2010, Cognition.

[54]  Marleen B. Schippers,et al.  Mapping the information flow from one brain to another during gestural communication , 2010, Proceedings of the National Academy of Sciences.

[55]  A. Sirigu,et al.  Racial Bias Reduces Empathic Sensorimotor Resonance with Other-Race Pain , 2010, Current Biology.

[56]  Shigeru Sato,et al.  Effect of motion smoothness on brain activity while observing a dance: An fMRI study using a humanoid robot , 2010, Social neuroscience.

[57]  R. Adolphs Conceptual Challenges and Directions for Social Neuroscience , 2010, Neuron.

[58]  Sukhvinder S. Obhi,et al.  Incidental action observation modulates muscle activity , 2010, Experimental Brain Research.

[59]  Marcel Brass,et al.  Top-down modulation of motor priming by belief about animacy. , 2010, Experimental psychology.

[60]  A. Hamilton,et al.  Triangles have goals too: Understanding action representation in left aIPS , 2010, Neuropsychologia.

[61]  James Stanley,et al.  How instructions modify perception: An fMRI study investigating brain areas involved in attributing human agency , 2010, NeuroImage.

[62]  Sotaro Shimada,et al.  Deactivation in the sensorimotor area during observation of a human agent performing robotic actions , 2010, Brain and Cognition.

[63]  S. Swinnen,et al.  Observing how others lift light or heavy objects: Which visual cues mediate the encoding of muscular force in the primary motor cortex? , 2010, Neuropsychologia.

[64]  Matthew D. Lieberman,et al.  Identifying the What, Why, and How of an Observed Action: An fMRI Study of Mentalizing and Mechanizing during Action Observation , 2011, Journal of Cognitive Neuroscience.

[65]  Clare Press,et al.  Neuroscience and Biobehavioral Reviews Action Observation and Robotic Agents: Learning and Anthropomorphism , 2022 .

[66]  Sook-Lei Liew,et al.  Familiarity modulates mirror neuron and mentalizing regions during intention understanding , 2011, Human brain mapping.

[67]  Antonia F. de C. Hamilton,et al.  Dissociation of mirroring and mentalising systems in autism , 2011, NeuroImage.

[68]  G. Orban,et al.  Neural mechanisms of understanding rational actions: middle temporal gyrus activation by contextual violation. , 2011, Cerebral cortex.