Neural decoding of unilateral upper limb movements using single trial MEG signals

A brain machine interface (BMI) provides the possibility of controlling such external devices as prosthetic arms for patients with severe motor dysfunction using their own brain signals. However, there have been few studies investigating the decoding accuracy for multiclasses of useful unilateral upper limb movements using non-invasive measurements. We investigated the decoding accuracy for classifying three types of unilateral upper limb movements using single-trial magnetoencephalography (MEG) signals. Neuromagnetic activities were recorded in 9 healthy subjects performing 3 types of right upper limb movements: hand grasping, pinching, and elbow flexion. A support vector machine was used to classify the single-trial MEG signals. The movement types were predicted with an average accuracy of 66 ± 10% (chance level: 33.3%) using neuromagnetic activity during a 400-ms interval (-200 ms to 200 ms from movement onsets). To explore the time-dependency of the decoding accuracy, we also examined the time course of decoding accuracy in 50-ms sliding windows from -500 ms to 500 ms. Decoding accuracies significantly increased and peaked once before (50.1 ± 4.9%) and twice after (58.5 ± 7.5% and 64.4 ± 7.6%) movement onsets in all subjects. Significant variability in the decoding features in the first peak was evident in the channels over the parietal area and in the second and third peaks in the channels over the sensorimotor area. Our results indicate that the three types of unilateral upper limb movement can be inferred with high accuracy by detecting differences in movement-related brain activity in the parietal and sensorimotor areas.

[1]  Masa-aki Sato,et al.  Evaluation of hierarchical Bayesian method through retinotopic brain activities reconstruction from fMRI and MEG signals , 2008, NeuroImage.

[2]  José Luis Contreras-Vidal,et al.  Decoding center-out hand velocity from MEG signals during visuomotor adaptation , 2009, NeuroImage.

[3]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[4]  H. Yokoi,et al.  Electrocorticographic control of a prosthetic arm in paralyzed patients , 2012, Annals of neurology.

[5]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[6]  P. Haggard Conscious intention and motor cognition , 2005, Trends in Cognitive Sciences.

[7]  R. Andersen,et al.  Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits , 2009, Neuron.

[8]  F. Jolesz,et al.  Brain–machine interface via real-time fMRI: Preliminary study on thought-controlled robotic arm , 2009, Neuroscience Letters.

[9]  M. Sams,et al.  EEG and MEG brain-computer interface for tetraplegic patients , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Masa-aki Sato,et al.  Reconstruction of two-dimensional movement trajectories from selected magnetoencephalography cortical currents by combined sparse Bayesian methods , 2011, NeuroImage.

[11]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. , 1998, Brain : a journal of neurology.

[12]  Trent J. Bradberry,et al.  Movement decoding from noninvasive neural signals , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[13]  C. Mehring,et al.  Inference of hand movements from local field potentials in monkey motor cortex , 2003, Nature Neuroscience.

[14]  Paul Ferrari,et al.  Self-paced movements induce high-frequency gamma oscillations in primary motor cortex , 2008, NeuroImage.

[15]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[16]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[17]  Hans-Jochen Heinze,et al.  Single trial discrimination of individual finger movements on one hand: A combined MEG and EEG study , 2012, NeuroImage.

[18]  R. Andersen,et al.  Intentional maps in posterior parietal cortex. , 2002, Annual review of neuroscience.

[19]  D. Cheyne,et al.  Spatiotemporal mapping of cortical activity accompanying voluntary movements using an event‐related beamforming approach , 2006, Human brain mapping.

[20]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[21]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[22]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[23]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[24]  A. Georgopoulos,et al.  Magnetoencephalographic signals predict movement trajectory in space , 2005, Experimental Brain Research.

[25]  Toshiki Yoshimine,et al.  Neural decoding using gyral and intrasulcal electrocorticograms , 2009, NeuroImage.

[26]  Ethan R. Buch,et al.  Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic Stroke , 2008, Stroke.

[27]  C. Mehring,et al.  Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials , 2005, The Journal of Neuroscience.

[28]  Niels Birbaumer,et al.  Real-time support vector classification and feedback of multiple emotional brain states , 2011, NeuroImage.

[29]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[30]  A Kübler,et al.  A P 300-based brain-computer interface for people with amyotrophic lateral sclerosis , 2010 .

[31]  C. Braun,et al.  A review on directional information in neural signals for brain-machine interfaces , 2009, Journal of Physiology-Paris.

[32]  J. Wolpaw,et al.  Decoding two-dimensional movement trajectories using electrocorticographic signals in humans , 2007, Journal of neural engineering.

[33]  B Lütkenhöner,et al.  A Neuromagnetic Study of the Functional Organization of the Sensorimotor Cortex , 1994, The European journal of neuroscience.

[34]  Miguel P. Eckstein,et al.  Predicting variations of perceptual performance across individuals from neural activity using pattern classifiers , 2010, NeuroImage.

[35]  L. Deecke,et al.  Neuromagnetic fields accompanying unilateral and bilateral voluntary movements: topography and analysis of cortical sources. , 1991, Electroencephalography and clinical neurophysiology.

[36]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[37]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[38]  H. Yokoi,et al.  Real-time control of a prosthetic hand using human electrocorticography signals. , 2011, Journal of neurosurgery.

[39]  P. Rossini,et al.  The bereitschaftspotential paradigm in investigating voluntary movement organization in humans using magnetoencephalography (MEG). , 1997, Brain research. Brain research protocols.

[40]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[41]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[42]  M. Sams,et al.  Classification of single MEG trials related to left and right index finger movements , 2006, Clinical Neurophysiology.

[43]  Srikantan S. Nagarajan,et al.  High-Frequency Oscillations in Distributed Neural Networks Reveal the Dynamics of Human Decision Making , 2007, Frontiers in human neuroscience.

[44]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Ronald N. Goodman,et al.  Neural decoding of treadmill walking from noninvasive electroencephalographic signals. , 2011, Journal of neurophysiology.

[46]  F. Guenther,et al.  A Wireless Brain-Machine Interface for Real-Time Speech Synthesis , 2009, PloS one.

[47]  J B Poline,et al.  Partially overlapping neural networks for real and imagined hand movements. , 2000, Cerebral cortex.

[48]  Masa-aki Sato,et al.  Hierarchical Bayesian estimation for MEG inverse problem , 2004, NeuroImage.

[49]  P. Haggard,et al.  Altered awareness of voluntary action after damage to the parietal cortex , 2004, Nature Neuroscience.

[50]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[51]  M. Desmurget,et al.  Movement Intention After Parietal Cortex Stimulation in Humans , 2009, Science.

[52]  Dan Wu,et al.  Combining Spatial Filters for the Classification of Single-Trial EEG in a Finger Movement Task , 2007, IEEE Transactions on Biomedical Engineering.

[53]  Karl J. Friston,et al.  EEG and MEG Data Analysis in SPM8 , 2011, Comput. Intell. Neurosci..

[54]  Mark Hallett,et al.  Spatial detection of multiple movement intentions from SAM-filtered single-trial MEG signals , 2009, Clinical Neurophysiology.

[55]  Trent J. Bradberry,et al.  Fast attainment of computer cursor control with noninvasively acquired brain signals , 2011, Journal of neural engineering.

[56]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[57]  M. Desmurget,et al.  A parietal-premotor network for movement intention and motor awareness , 2009, Trends in Cognitive Sciences.