The Representation of Finger Movement and Force in Human Motor and Premotor Cortices

Abstract The ability to grasp and manipulate objects requires controlling both finger movement kinematics and isometric force in rapid succession. Previous work suggests that these behavioral modes are controlled separately, but it is unknown whether the cerebral cortex represents them differently. Here, we asked the question of how movement and force were represented cortically, when executed sequentially with the same finger. We recorded high-density electrocorticography (ECoG) from the motor and premotor cortices of seven human subjects performing a movement-force motor task. We decoded finger movement [0.7 ± 0.3 fractional variance accounted for (FVAF)] and force (0.7 ± 0.2 FVAF) with high accuracy, yet found different spatial representations. In addition, we used a state-of-the-art deep learning method to uncover smooth, repeatable trajectories through ECoG state space during the movement-force task. We also summarized ECoG across trials and participants by developing a new metric, the neural vector angle (NVA). Thus, state-space techniques can help to investigate broad cortical networks. Finally, we were able to classify the behavioral mode from neural signals with high accuracy (90 ± 6%). Thus, finger movement and force appear to have distinct representations in motor/premotor cortices. These results inform our understanding of the neural control of movement, as well as the design of grasp brain-machine interfaces (BMIs).

[1]  Mariska J Vansteensel,et al.  Preservation of hand movement representation in the sensorimotor areas of amputees , 2017, Brain : a journal of neurology.

[2]  Francis R. Willett,et al.  Online adaptive decoding of intended movements with a hybrid kinetic and kinematic brain machine interface , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[4]  Michael L. Boninger,et al.  Implicit Grasp Force Representation in Human Motor Cortical Recordings , 2018, Front. Neurosci..

[5]  Hansjörg Scherberger,et al.  Neural coding of intended and executed grasp force in macaque areas AIP, F5, and M1 , 2018, Scientific Reports.

[6]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[7]  N.G. Hatsopoulos,et al.  Kinetic Trajectory Decoding Using Motor Cortical Ensembles , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  M. J. Korenberg,et al.  The identification of nonlinear biological systems: Wiener and Hammerstein cascade models , 1986, Biological Cybernetics.

[9]  T J Ebner,et al.  Primary motor cortex neuronal discharge during reach-to-grasp: controlling the hand as a unit. , 2002, Archives italiennes de biologie.

[10]  Odelia Schwartz,et al.  Decoding of finger trajectory from ECoG using deep learning , 2018, Journal of neural engineering.

[11]  N. Thakor,et al.  Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand , 2010, Journal of neural engineering.

[12]  Yasuharu Koike,et al.  Decoding grasp force profile from electrocorticography signals in non-human primate sensorimotor cortex , 2014, Neuroscience Research.

[13]  E. Evarts,et al.  Relation of pyramidal tract activity to force exerted during voluntary movement. , 1968, Journal of neurophysiology.

[14]  Kazutaka Takahashi,et al.  Neural coordination during reach-to-grasp. , 2015, Journal of neurophysiology.

[15]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[16]  Francisco J Valero-Cuevas,et al.  Neural Control of Motion-to-Force Transitions with the Fingertip , 2008, The Journal of Neuroscience.

[17]  Chethan Pandarinath,et al.  LFADS - Latent Factor Analysis via Dynamical Systems , 2016, ArXiv.

[18]  Matthew S. Fifer,et al.  Cortical subnetwork dynamics during human language tasks , 2016, NeuroImage.

[19]  Zoran Nenadic,et al.  Extracting kinetic information from human motor cortical signals , 2014, NeuroImage.

[20]  Mariska J Vansteensel,et al.  High-frequency band temporal dynamics in response to a grasp force task , 2019, Journal of neural engineering.

[21]  J R Flanagan,et al.  Composition and Decomposition of Internal Models in Motor Learning under Altered Kinematic and Dynamic Environments , 1999, The Journal of Neuroscience.

[22]  Nicholas V. Annetta,et al.  Restoring cortical control of functional movement in a human with quadriplegia , 2016, Nature.

[23]  Timothy J Ebner,et al.  Signaling of grasp dimension and grasp force in dorsal premotor cortex and primary motor cortex neurons during reach to grasp in the monkey. , 2009, Journal of neurophysiology.

[24]  Marc W Slutzky,et al.  Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations , 2019, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[25]  Francis R. Willett,et al.  Neural Representation of Observed, Imagined, and Attempted Grasping Force in Motor Cortex of Individuals with Chronic Tetraplegia , 2020, Scientific Reports.

[26]  Jens Frahm,et al.  Functional somatotopy of finger representations in human primary motor cortex , 2003, Human brain mapping.

[27]  Yasuharu Koike,et al.  Decoding fingertip trajectory from electrocorticographic signals in humans , 2014, Neuroscience Research.

[28]  H. Yokoi,et al.  Electrocorticographic control of a prosthetic arm in paralyzed patients , 2012, Annals of neurology.

[29]  Christian Ethier,et al.  Cortical population activity within a preserved neural manifold underlies multiple motor behaviors , 2018, Nature Communications.

[30]  Andreas Schulze-Bonhage,et al.  Grasp Detection from Human ECoG during Natural Reach-to-Grasp Movements , 2013, PloS one.

[31]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[32]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[33]  Chethan Pandarinath,et al.  Inferring single-trial neural population dynamics using sequential auto-encoders , 2017, Nature Methods.

[34]  Mariska J Vansteensel,et al.  Encoding of kinetic and kinematic movement parameters in the sensorimotor cortex: A Brain‐Computer Interface perspective , 2019, The European journal of neuroscience.

[35]  Robert D Flint,et al.  Physiological properties of brain-machine interface input signals. , 2017, Journal of neurophysiology.

[36]  Marc H Schieber,et al.  Motor cortex and the distributed anatomy of finger movements. , 2002, Advances in experimental medicine and biology.

[37]  John D. Simeral,et al.  Watch, Imagine, Attempt: Motor Cortex Single-Unit Activity Reveals Context-Dependent Movement Encoding in Humans With Tetraplegia , 2018, Front. Hum. Neurosci..

[38]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[39]  Marc W. Slutzky,et al.  Continuous decoding of human grasp kinematics using epidural and subdural signals , 2017, Journal of neural engineering.

[40]  Nicholas G Hatsopoulos,et al.  Incorporating Feedback from Multiple Sensory Modalities Enhances Brain–Machine Interface Control , 2010, The Journal of Neuroscience.

[41]  Zoran Nenadic,et al.  Comparison of decoding resolution of standard and high-density electrocorticogram electrodes , 2016, Journal of neural engineering.

[42]  J Randall Flanagan,et al.  Separate Contributions of Kinematic and Kinetic Errors to Trajectory and Grip Force Adaptation When Transporting Novel Hand-Held Loads , 2013, The Journal of Neuroscience.

[43]  An H. Do,et al.  Hemicraniectomy in Traumatic Brain Injury: A Noninvasive Platform to Investigate High Gamma Activity for Brain Machine Interfaces , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Robert A Gaunt,et al.  Motor cortical activity changes during neuroprosthetic-controlled object interaction , 2017, Scientific Reports.

[45]  K. Lynch,et al.  The Separate Neural Control of Hand Movements and Contact Forces , 2009, The Journal of Neuroscience.

[46]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[47]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[48]  Vikash Gilja,et al.  Assessment of brain–machine interfaces from the perspective of people with paralysis , 2015, Journal of neural engineering.

[49]  Lee E Miller,et al.  Movement representation in the primary motor cortex and its contribution to generalizable EMG predictions. , 2013, Journal of neurophysiology.

[50]  R. Lemon,et al.  Contribution of the monkey corticomotoneuronal system to the control of force in precision grip. , 1993, Journal of neurophysiology.