Motor imagery of hand actions: Decoding the content of motor imagery from brain activity in frontal and parietal motor areas

How motor maps are organized while imagining actions is an intensely debated issue. It is particularly unclear whether motor imagery relies on action‐specific representations in premotor and posterior parietal cortices. This study tackled this issue by attempting to decode the content of motor imagery from spatial patterns of Blood Oxygen Level Dependent (BOLD) signals recorded in the frontoparietal motor imagery network. During fMRI‐scanning, 20 right‐handed volunteers worked on three experimental conditions and one baseline condition. In the experimental conditions, they had to imagine three different types of right‐hand actions: an aiming movement, an extension–flexion movement, and a squeezing movement. The identity of imagined actions was decoded from the spatial patterns of BOLD signals they evoked in premotor and posterior parietal cortices using multivoxel pattern analysis. Results showed that the content of motor imagery (i.e., the action type) could be decoded significantly above chance level from the spatial patterns of BOLD signals in both frontal (PMC, M1) and parietal areas (SPL, IPL, IPS). An exploratory searchlight analysis revealed significant clusters motor‐ and motor‐associated cortices, as well as in visual cortices. Hence, the data provide evidence that patterns of activity within premotor and posterior parietal cortex vary systematically with the specific type of hand action being imagined. Hum Brain Mapp 37:81–93, 2016. © 2015 The Authors. Human Brain Mapping Published by Wiley Periodicals, Inc.

[1]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[2]  M. Hallett,et al.  Cerebral structures participating in motor preparation in humans: a positron emission tomography study. , 1996, Journal of neurophysiology.

[3]  Leonardo Fogassi,et al.  Motor functions of the parietal lobe , 2005, Current Opinion in Neurobiology.

[4]  E. Zohary,et al.  Topographic Representation of the Human Body in the Occipitotemporal Cortex , 2010, Neuron.

[5]  M. Hallett,et al.  Motor planning, imagery, and execution in the distributed motor network: a time-course study with functional MRI. , 2008, Cerebral cortex.

[6]  Paul E. Downing,et al.  Viewpoint (In)dependence of Action Representations: An MVPA Study , 2012, Journal of Cognitive Neuroscience.

[7]  J. Kalaska,et al.  Cerebral cortical mechanisms of reaching movements. , 1992, Science.

[8]  Babak A. Ardekani,et al.  Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans , 2005, Journal of Neuroscience Methods.

[9]  M. Jeannerod.  Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[10]  Christoph Stippich,et al.  Somatotopic mapping of the human primary sensorimotor cortex during motor imagery and motor execution by functional magnetic resonance imaging , 2002, Neuroscience Letters.

[11]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[12]  Marco Iacoboni,et al.  Are cortical motor maps based on body parts or coordinated actions? Implications for embodied semantics , 2010, Brain and Language.

[13]  G. Rizzolatti,et al.  Functional organization of inferior area 6 in the macaque monkey , 2004, Experimental Brain Research.

[14]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[15]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[16]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[17]  M. Desmurget,et al.  Movement Intention After Parietal Cortex Stimulation in Humans , 2009, Science.

[18]  Anjali Krishnan,et al.  Cluster-extent based thresholding in fMRI analyses: Pitfalls and recommendations , 2014, NeuroImage.

[19]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[21]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[22]  J Randall Flanagan,et al.  Where One Hand Meets the Other: Limb-Specific and Action-Dependent Movement Plans Decoded from Preparatory Signals in Single Human Frontoparietal Brain Areas , 2013, The Journal of Neuroscience.

[23]  M Jeannerod,et al.  The hand and the object: the role of posterior parietal cortex in forming motor representations. , 1994, Canadian journal of physiology and pharmacology.

[24]  Aina Puce,et al.  Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex , 2004, NeuroImage.

[25]  Nikolaus Kriegeskorte,et al.  Comparison of multivariate classifiers and response normalizations for pattern-information fMRI , 2010, NeuroImage.

[26]  Lars Muckli,et al.  Decoding Sound and Imagery Content in Early Visual Cortex , 2014, Current Biology.

[27]  J. Mazziotta,et al.  Mapping motor representations with positron emission tomography , 1994, Nature.

[28]  M. Jeannerod,et al.  Mentally simulated movements in virtual reality: does Fitt's law hold in motor imagery? , 1995, Behavioural Brain Research.

[29]  Laehyun Kim,et al.  Which motor cortical region best predicts imagined movement? , 2015, NeuroImage.

[30]  W. Penfield,et al.  SOMATIC MOTOR AND SENSORY REPRESENTATION IN THE CEREBRAL CORTEX OF MAN AS STUDIED BY ELECTRICAL STIMULATION , 1937 .

[31]  Garrison W Cottrell,et al.  Observed, Executed, and Imagined Action Representations can be Decoded From Ventral and Dorsal Areas. , 2015, Cerebral cortex.

[32]  Masato Taira,et al.  Motor cortical activity preceding a memorized movement trajectory with an orthogonal bend , 1993, Experimental Brain Research.

[33]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[34]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[35]  R. Schubotz.  Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[36]  Geraint Rees,et al.  Auditory modulation of visual stimulus encoding in human retinotopic cortex , 2013, NeuroImage.

[37]  J. Tanji,et al.  Distinctions between dorsal and ventral premotor areas: anatomical connectivity and functional properties , 2007, Current Opinion in Neurobiology.

[38]  Kenneth F. Valyear,et al.  Decoding Action Intentions from Preparatory Brain Activity in Human Parieto-Frontal Networks , 2011, The Journal of Neuroscience.

[39]  T. Ebner,et al.  Temporal encoding of movement kinematics in the discharge of primate primary motor and premotor neurons. , 1995, Journal of neurophysiology.

[40]  Ivan Toni,et al.  Posture influences motor imagery: An fMRI study , 2006, NeuroImage.

[41]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.

[42]  D. Crammond.  Motor imagery: never in your wildest dream , 1997, Trends in Neurosciences.

[43]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[44]  Julien Doyon,et al.  Functional neuroanatomical networks associated with expertise in motor imagery , 2008, NeuroImage.

[45]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[46]  R. Andersen,et al.  Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits , 2009, Neuron.

[47]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[48]  D Yves von Cramon,et al.  Motion Class Dependency in Observers' Motor Areas Revealed by Functional Magnetic Resonance Imaging , 2005, The Journal of Neuroscience.

[49]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[50]  Aymeric Guillot,et al.  Multiple roles of motor imagery during action observation , 2013, Front. Hum. Neurosci..

[51]  C. Gross,et al.  Spatial maps for the control of movement , 1998, Current Opinion in Neurobiology.

[52]  G. Rizzolatti,et al.  Parietal cortex: from sight to action , 1997, Current Opinion in Neurobiology.

[53]  M. Lotze,et al.  Motor imagery , 2006, Journal of Physiology-Paris.

[54]  Karen Zentgraf,et al.  Simulation during observation of human actions – Theories, empirical studies, applications , 2011, Vision Research.

[55]  Brigitte Röder,et al.  Functional Rather than Effector-Specific Organization of Human Posterior Parietal Cortex , 2011, The Journal of Neuroscience.

[56]  D. Yves von Cramon,et al.  Understanding non-biological dynamics with your own premotor system , 2007, NeuroImage.

[57]  Richard S. J. Frackowiak,et al.  A Blueprint for Movement: Functional and Anatomical Representations in the Human Motor System , 1999, The Journal of Neuroscience.

[58]  Stefan Geyer,et al.  Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. , 2003, Journal of neurophysiology.

[59]  R. Turner,et al.  Characterizing Dynamic Brain Responses with fMRI: A Multivariate Approach , 1995, NeuroImage.

[60]  Fraser W. Smith,et al.  Decoding Effector-Dependent and Effector-Independent Movement Intentions from Human Parieto-Frontal Brain Activity , 2011, The Journal of Neuroscience.

[61]  S. Wise.  The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[62]  Robert Turner,et al.  Image Distortion Correction in fMRI: A Quantitative Evaluation , 2002, NeuroImage.

[63]  R. Andersen,et al.  Intentional maps in posterior parietal cortex. , 2002, Annual review of neuroscience.

[64]  E. Rolls.  The parietal cortex , 2001 .

[65]  H. Alkadhi,et al.  Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. , 1997, Brain : a journal of neurology.

[66]  N. Kanwisher,et al.  The Human Body , 2001 .

[67]  D. V. Cramon,et al.  Functional–anatomical concepts of human premotor cortex: evidence from fMRI and PET studies , 2003, NeuroImage.

[68]  J. Mazziotta,et al.  Lateralization of the Human Mirror Neuron System , 2006, The Journal of Neuroscience.

[69]  Paul E. Downing,et al.  Visuo-motor imagery of specific manual actions: A multi-variate pattern analysis fMRI study , 2012, NeuroImage.

[70]  R. Schubotz.  Human premotor cortex : beyond motor performance , 2004 .

[71]  W. T. Thach,et al.  Motor mechanisms of the CNS: cerebrocerebellar interrelations. , 1969, Annual review of physiology.

[72]  G. Fink,et al.  Identifying Neuroimaging Markers of Motor Disability in Acute Stroke by Machine Learning Techniques. , 2015, Cerebral cortex.

[73]  J. Donoghue,et al.  Plasticity and primary motor cortex. , 2000, Annual review of neuroscience.

[74]  K. Zentgraf,et al.  Cognitive motor processes: The role of motor imagery in the study of motor representations , 2009, Brain Research Reviews.

[75]  G. Orban,et al.  Coding observed motor acts: different organizational principles in the parietal and premotor cortex of humans. , 2010, Journal of neurophysiology.

[76]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[77]  Jonathan D. Nelson,et al.  Human cortical representations for reaching: Mirror neurons for execution, observation, and imagery , 2007, NeuroImage.

[78]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[79]  Dieter Vaitl,et al.  Neural simulation of actions: Effector‐ versus action‐specific motor maps within the human premotor and posterior parietal area? , 2014, Human brain mapping.

[80]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[81]  Christian Keysers,et al.  Expanding the mirror: vicarious activity for actions, emotions, and sensations , 2009, Current Opinion in Neurobiology.

[82]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.