Global cortical activity predicts shape of hand during grasping

Recent studies show that the amplitude of cortical field potentials is modulated in the time domain by grasping kinematics. However, it is unknown if these low frequency modulations persist and contain enough information to decode grasp kinematics in macro-scale activity measured at the scalp via electroencephalography (EEG). Further, it is unclear as to whether joint angle velocities or movement synergies are the optimal kinematics spaces to decode. In this offline decoding study, we infer from human EEG, hand joint angular velocities as well as synergistic trajectories as subjects perform natural reach-to-grasp movements. Decoding accuracy, measured as the correlation coefficient (r) between the predicted and actual movement kinematics, was r = 0.49 ± 0.02 across 15 hand joints. Across the first three kinematic synergies, decoding accuracies were r = 0.59 ± 0.04, 0.47 ± 0.06, and 0.32 ± 0.05. The spatial-temporal pattern of EEG channel recruitment showed early involvement of contralateral frontal-central scalp areas followed by later activation of central electrodes over primary sensorimotor cortical areas. Information content in EEG about the grasp type peaked at 250 ms after movement onset. The high decoding accuracies in this study are significant not only as evidence for time-domain modulation in macro-scale brain activity, but for the field of brain-machine interfaces as well. Our decoding strategy, which harnesses the neural “symphony” as opposed to local members of the neural ensemble (as in intracranial approaches), may provide a means of extracting information about motor intent for grasping without the need for penetrating electrodes and suggests that it may be soon possible to develop non-invasive neural interfaces for the control of prosthetic limbs.

[1]  Maarten J. IJzerman,et al.  Survey of the needs of patients with spinal cord injury: impact and priority for improvement in hand function in tetraplegics , 2004, Spinal Cord.

[2]  Arjun K. Bansal,et al.  Relationships among low-frequency local field potentials, spiking activity, and three-dimensional reach and grasp kinematics in primary motor and ventral premotor cortices. , 2011, Journal of neurophysiology.

[3]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[4]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[5]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[6]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[7]  Los AlamOs Nallon Testing for nonlinearity in time series: the method of surrogate data — Source link , 2005 .

[8]  John P. Donoghue,et al.  Decoding 3-D Reach and Grasp Kinematics From High-Frequency Local Field Potentials in Primate Primary Motor Cortex , 2010, IEEE Transactions on Biomedical Engineering.

[9]  T. Kuiken,et al.  Neural Interfaces for Control of Upper Limb Prostheses: The State of the Art and Future Possibilities , 2011, PM & R : the journal of injury, function, and rehabilitation.

[10]  J. Millán,et al.  Single trial analysis of slow cortical potentials: a study on anticipation related potentials , 2013, Journal of neural engineering.

[11]  Yali Amit,et al.  Encoding of Coordinated Grasp Trajectories in Primary Motor Cortex , 2010, The Journal of Neuroscience.

[12]  R Kawashima,et al.  Changes in rCBF during grasping in humans examined by PET , 1996, Neuroreport.

[13]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[14]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[15]  Zhi-Hong Mao,et al.  Dimensionality Reduction in Control and Coordination of the Human Hand , 2008, IEEE Transactions on Biomedical Engineering.

[16]  U. Castiello The neuroscience of grasping , 2005, Nature Reviews Neuroscience.

[17]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[18]  U. Castiello The neuroscience of grasping , 2005, Nature Reviews Neuroscience.

[19]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[20]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[22]  Andreas Schulze-Bonhage,et al.  Decoding natural grasp types from human ECoG , 2012, NeuroImage.

[23]  Jose L. Contreras-Vidal,et al.  Observation-based calibration of brain-machine interfaces for grasping , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[24]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[25]  Trent J. Bradberry,et al.  Fast attainment of computer cursor control with noninvasively acquired brain signals , 2011, Journal of neural engineering.

[26]  Marco Santello,et al.  Patterns of Hand Motion during Grasping and the Influence of Sensory Guidance , 2002, The Journal of Neuroscience.

[27]  José Luis Contreras-Vidal,et al.  Decoding center-out hand velocity from MEG signals during visuomotor adaptation , 2009, NeuroImage.

[28]  Thomas M. Hall,et al.  A Common Structure Underlies Low-Frequency Cortical Dynamics in Movement, Sleep, and Sedation , 2014, Neuron.

[29]  G. Rizzolatti,et al.  Object representation in the ventral premotor cortex (area F5) of the monkey. , 1997, Journal of neurophysiology.

[30]  J. Wolpaw,et al.  Decoding flexion of individual fingers using electrocorticographic signals in humans , 2009, Journal of neural engineering.

[31]  J. Wolpaw,et al.  EMG contamination of EEG: spectral and topographical characteristics , 2003, Clinical Neurophysiology.

[32]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[33]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[34]  Michael J. Black,et al.  Decoding grasp aperture from motor-cortical population activity , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[35]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[36]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  A Pouget,et al.  Decoding M1 neurons during multiple finger movements. , 2007, Journal of neurophysiology.

[38]  Andreas Schulze-Bonhage,et al.  Movement related activity in the high gamma range of the human EEG , 2008, NeuroImage.

[39]  Mikhail A. Lebedev,et al.  Recognition of Handwriting from Electromyography , 2009, PloS one.

[40]  G. Rizzolatti,et al.  Functional organization of inferior area 6 in the macaque monkey , 2004, Experimental Brain Research.

[41]  M. Jeannerod The timing of natural prehension movements. , 1984, Journal of motor behavior.

[42]  Jose L. Contreras-Vidal,et al.  Decoding hand and cursor kinematics from magnetoencephalographic signals during tool use , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  N. Thakor,et al.  Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand , 2010, Journal of neural engineering.

[44]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[45]  Mohsen Mollazadeh,et al.  Spatiotemporal Variation of Multiple Neurophysiological Signals in the Primary Motor Cortex during Dexterous Reach-to-Grasp Movements , 2011, The Journal of Neuroscience.

[46]  Andrew Y. Paek,et al.  Decoding repetitive finger movements with brain activity acquired via non-invasive electroencephalography , 2014, Front. Neuroeng..

[47]  N. Birbaumer,et al.  On the Usage of Linear Regression Models to Reconstruct Limb Kinematics from Low Frequency EEG Signals , 2013, PloS one.

[48]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[49]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[50]  C. Braun,et al.  A review on directional information in neural signals for brain-machine interfaces , 2009, Journal of Physiology-Paris.

[51]  Erk Subasi,et al.  Grasp Movement Decoding from Premotor and Parietal Cortex , 2011, The Journal of Neuroscience.

[52]  N. Cristianini,et al.  On Kernel-Target Alignment , 2001, NIPS.

[53]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[54]  G. Rizzolatti,et al.  Functional organization of inferior area 6 in the macaque monkey , 1988, Experimental Brain Research.

[55]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[56]  José Luis Contreras-Vidal,et al.  Reconstructing hand kinematics during reach to grasp movements from electroencephalographic signals , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[57]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[58]  Bin He,et al.  Relationship between speed and EEG activity during imagined and executed hand movements , 2010, Journal of neural engineering.

[59]  Hyun-Chool Shin,et al.  Asynchronous Decoding of Dexterous Finger Movements Using M1 Neurons , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.