Seeing biological actions in 3D: An fMRI study

Precise kinematics or body configuration cannot be recovered from visual input without disparity information. Yet, no imaging study has investigated the role of disparity on action observation. Here, we investigated the interaction between disparity and the main cues of biological motion, kinematics and configuration, in two fMRI experiments. Stimuli were presented as point‐light figures, depicting complex action sequences lasting 21 s. We hypothesized that interactions could occur at any of the three levels of the action observation network, comprising occipitotemporal, parietal and premotor cortex, with premotor cortex being the most likely location. The main effects of kinematics and configuration confirmed that the biological motion sequences activated all three levels of the action observation network, validating our approach. The interaction between configuration and disparity activated only premotor cortex, whereas interactions between kinematics and disparity occurred at all levels of the action observation network but were strongest at the premotor level. Control experiments demonstrated that these interactions could not be accounted for by low level motion in depth, task effects, spatial attention, or eye movements, including vergence. These results underscore the role of premotor cortex in action observation, and in imitating others or responding to their actions. Hum Brain Mapp 37:203–219, 2016. © 2015 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

[1]  D. Bouwhuis,et al.  Perceived depth and the feeling of presence in 3DTV , 1998 .

[2]  Aina Puce,et al.  Configural Processing of Biological Motion in Human Superior Temporal Sulcus , 2005, The Journal of Neuroscience.

[3]  Simon B Eickhoff,et al.  Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis , 2012, Human brain mapping.

[4]  M. Giese,et al.  Visual Learning Shapes the Processing of Complex Movement Stimuli in the Human Brain , 2009, The Journal of Neuroscience.

[5]  D. Regan,et al.  Hitting what one wants to hit and missing what one wants to miss , 2001, Vision Research.

[6]  K Kani,et al.  Stereopsis-processing regions in the human parieto-occipital cortex , 2001, Neuroreport.

[7]  L. Cormack,et al.  Disparity- and velocity-based signals for three-dimensional motion perception in human MT+ , 2009, Nature Neuroscience.

[8]  Scott T. Grafton,et al.  Evidence for a distributed hierarchy of action representation in the brain. , 2007, Human movement science.

[9]  G. Orban,et al.  Coding observed motor acts: different organizational principles in the parietal and premotor cortex of humans. , 2010, Journal of neurophysiology.

[10]  Aina Puce,et al.  Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex , 2004, NeuroImage.

[11]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[12]  Guy A. Orban,et al.  Integration of shape and motion cues in biological motion processing in the monkey STS , 2012, NeuroImage.

[13]  C. Büchel,et al.  Surface orientation discrimination activates caudal and anterior intraparietal sulcus in humans: an event-related fMRI study. , 2001, Journal of neurophysiology.

[14]  J. Mattingley,et al.  Is the mirror neuron system involved in imitation? A short review and meta-analysis , 2009, Neuroscience & Biobehavioral Reviews.

[15]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[16]  Matthew R. G. Brown,et al.  Neural processes associated with antisaccade task performance investigated with event-related FMRI. , 2005, Journal of neurophysiology.

[17]  Guy A. Orban,et al.  Monkey Cortex through fMRI Glasses , 2014, Neuron.

[18]  D Yves von Cramon,et al.  Motion Class Dependency in Observers' Motor Areas Revealed by Functional Magnetic Resonance Imaging , 2005, The Journal of Neuroscience.

[19]  Michael Petrides,et al.  Local Morphology Predicts Functional Organization of the Dorsal Premotor Region in the Human Brain , 2006, The Journal of Neuroscience.

[20]  Patric Bach,et al.  “Feeling” others' painful actions: The sensorimotor integration of pain and action information, , 2012, Human brain mapping.

[21]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[22]  Raymond H. Cuijpers,et al.  The role of inferior frontal and parietal areas in differentiating meaningful and meaningless object-directed actions , 2010, Brain Research.

[23]  Ronald R. Peeters,et al.  A human homologue of monkey F5c , 2015, NeuroImage.

[24]  T Mergner,et al.  Saccadic reaction times in patients with frontal and parietal lesions. , 1992, Brain : a journal of neurology.

[25]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[26]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[27]  Edward T. Bullmore,et al.  A direct demonstration of functional specialization within motion-related visual and auditory cortex of the human brain , 1996, Current Biology.

[28]  Lora T. Likova,et al.  Stereomotion processing in the human occipital cortex , 2007, NeuroImage.

[29]  Johannes Bernarding,et al.  Event-related functional magnetic resonance imaging (efMRI) of depth-by-disparity perception: additional evidence for right-hemispheric lateralization , 2009, Experimental Brain Research.

[30]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[31]  B. J. McCurtain,et al.  Dorsal cortical regions subserving visually guided saccades in humans: an fMRI study. , 1998, Cerebral cortex.

[32]  Z. Kourtzi,et al.  Multivoxel Pattern Selectivity for Perceptually Relevant Binocular Disparities in the Human Brain , 2008, The Journal of Neuroscience.

[33]  G. Rizzolatti,et al.  Cortical mechanisms underlying the organization of goal-directed actions and mirror neuron-based action understanding. , 2014, Physiological reviews.

[34]  Randolph Blake,et al.  Neural Integration of Information Specifying Human Structure from Form, Motion, and Depth , 2010, The Journal of Neuroscience.

[35]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[36]  D. Gitelman,et al.  Functional Specificity of Superior Parietal Mediation of Spatial Shifting , 2001, NeuroImage.

[37]  Timothy Edward John Behrens,et al.  Diffusion-Weighted Imaging Tractography-Based Parcellation of the Human Lateral Premotor Cortex Identifies Dorsal and Ventral Subregions with Anatomical and Functional Specializations , 2007, The Journal of Neuroscience.

[38]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[39]  Svetlana S. Georgieva,et al.  The Processing of Three-Dimensional Shape from Disparity in the Human Brain , 2009, The Journal of Neuroscience.

[40]  G. Orban,et al.  Human Functional Magnetic Resonance Imaging Reveals Separation and Integration of Shape and Motion Cues in Biological Motion Processing , 2009, The Journal of Neuroscience.

[41]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[42]  Gregory Króliczak,et al.  A common network in the left cerebral hemisphere represents planning of tool use pantomimes and familiar intransitive gestures at the hand-independent level. , 2009, Cerebral cortex.

[43]  G. Orban,et al.  Specificity of regions processing biological motion , 2005, The European journal of neuroscience.

[44]  T. Paus Location and function of the human frontal eye-field: A selective review , 1996, Neuropsychologia.

[45]  David J Heeger,et al.  Stereoscopic processing of absolute and relative disparity in human visual cortex. , 2004, Journal of neurophysiology.

[46]  G. Rizzolatti,et al.  Mirror Neurons Differentially Encode the Peripersonal and Extrapersonal Space of Monkeys , 2009, Science.

[47]  Tomoka Naganuma,et al.  Information processing of geometrical features of a surface based on binocular disparity cues: an fMRI study , 2005, Neuroscience Research.

[48]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[49]  P. Sinha,et al.  Functional neuroanatomy of biological motion perception in humans , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[50]  G. Orban,et al.  Common and segregated processing of observed actions in human SPL. , 2013, Cerebral cortex.

[51]  R. Lemon,et al.  What We Know Currently about Mirror Neurons , 2013, Current Biology.

[52]  Adam G. Thomas,et al.  Comparison of Human Ventral Frontal Cortex Areas for Cognitive Control and Language with Areas in Monkey Frontal Cortex , 2014, Neuron.

[53]  Ravi S. Menon,et al.  Functional connectivity of the frontal eye fields in humans and macaque monkeys investigated with resting-state fMRI. , 2012, Journal of neurophysiology.

[54]  Doris Y. Tsao,et al.  Stereopsis Activates V3A and Caudal Intraparietal Areas in Macaques and Humans , 2003, Neuron.

[55]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[56]  E. Vatikiotis-Bateson,et al.  Perceiving Biological Motion: Dissociating Visible Speech from Walking , 2003, Journal of Cognitive Neuroscience.

[57]  Frank Van Overwalle,et al.  Understanding others' actions and goals by mirror and mentalizing systems: A meta-analysis , 2009, NeuroImage.

[58]  D. V. van Essen,et al.  A Population-Average, Landmark- and Surface-based (PALS) atlas of human cerebral cortex. , 2005, NeuroImage.

[59]  David J. Fleet,et al.  Human cortical activity correlates with stereoscopic depth perception. , 2001, Journal of neurophysiology.

[60]  M. Brass,et al.  Imitation: is cognitive neuroscience solving the correspondence problem? , 2005, Trends in Cognitive Sciences.

[61]  Alessandro Livi,et al.  Space-Dependent Representation of Objects and Other's Action in Monkey Ventral Premotor Grasping Neurons , 2014, The Journal of Neuroscience.

[62]  Andrea Serino,et al.  Suppression of premotor cortex disrupts motor coding of peripersonal space , 2012, NeuroImage.

[63]  Christian Keysers,et al.  The anthropomorphic brain: The mirror neuron system responds to human and robotic actions , 2007, NeuroImage.

[64]  M. Sereno,et al.  Point-Light Biological Motion Perception Activates Human Premotor Cortex , 2004, The Journal of Neuroscience.

[65]  D. Regan,et al.  Monocular discrimination of the direction of motion in depth , 1994, Vision Research.

[66]  Ralph Weidner,et al.  Neural Mechanisms of Attentional Reorienting in Three-Dimensional Space , 2012, The Journal of Neuroscience.

[67]  G. Orban,et al.  Action Observation Circuits in the Macaque Monkey Cortex , 2011, The Journal of Neuroscience.

[68]  G. Rizzolatti,et al.  View-Based Encoding of Actions in Mirror Neurons of Area F5 in Macaque Premotor Cortex , 2011, Current Biology.

[69]  Alex R. Wade,et al.  The specificity of cortical region KO to depth structure , 2006, NeuroImage.

[70]  Guy A. Orban,et al.  Fine-grained stimulus representations in body selective areas of human occipito-temporal cortex , 2014, NeuroImage.

[71]  B. Bertenthal,et al.  Does Perception of Biological Motion Rely on Specific Brain Regions? , 2001, NeuroImage.

[72]  J. Mattingley,et al.  Brain regions with mirror properties: A meta-analysis of 125 human fMRI studies , 2012, Neuroscience & Biobehavioral Reviews.