Single trial discrimination of individual finger movements on one hand: A combined MEG and EEG study

It is crucial to understand what brain signals can be decoded from single trials with different recording techniques for the development of Brain-Machine Interfaces. A specific challenge for non-invasive recording methods are activations confined to small spatial areas on the cortex such as the finger representation of one hand. Here we study the information content of single trial brain activity in non-invasive MEG and EEG recordings elicited by finger movements of one hand. We investigate the feasibility of decoding which of four fingers of one hand performed a slight button press. With MEG we demonstrate reliable discrimination of single button presses performed with the thumb, the index, the middle or the little finger (average over all subjects and fingers 57%, best subject 70%, empirical guessing level: 25.1%). EEG decoding performance was less robust (average over all subjects and fingers 43%, best subject 54%, empirical guessing level 25.1%). Spatiotemporal patterns of amplitude variations in the time series provided best information for discriminating finger movements. Non-phase-locked changes of mu and beta oscillations were less predictive. Movement related high gamma oscillations were observed in average induced oscillation amplitudes in the MEG but did not provide sufficient information about the finger's identity in single trials. Importantly, pre-movement neuronal activity provided information about the preparation of the movement of a specific finger. Our study demonstrates the potential of non-invasive MEG to provide informative features for individual finger control in a Brain-Machine Interface neuroprosthesis.

[1]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[2]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[3]  Rajesh P. N. Rao,et al.  Spectral Changes in Cortical Surface Potentials during Motor Movement , 2007, The Journal of Neuroscience.

[4]  E. Fetz,et al.  Decoupling the Cortical Power Spectrum Reveals Real-Time Representation of Individual Finger Movements in Humans , 2009, The Journal of Neuroscience.

[5]  Arjun K. Bansal,et al.  Title: Relationships among Low-frequency Local Field Potentials, Spiking Activity and 2 3-d Reach and Grasp Kinematics in Primary Motor and Ventral Premotor Cortices 3 4 Running Head: Lf-lfp, Spikes and 3-d Reach and Grasp Kinematics 13 , 2011 .

[6]  Jens Frahm,et al.  Functional somatotopy of finger representations in human primary motor cortex , 2003, Human brain mapping.

[7]  H. Alkadhi,et al.  Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. , 1997, Brain : a journal of neurology.

[8]  A Pouget,et al.  Decoding M1 neurons during multiple finger movements. , 2007, Journal of neurophysiology.

[9]  S. P. Levine,et al.  Spatiotemporal patterns of beta desynchronization and gamma synchronization in corticographic data during self-paced movement , 2003, Clinical Neurophysiology.

[10]  Paul Ferrari,et al.  Self-paced movements induce high-frequency gamma oscillations in primary motor cortex , 2008, NeuroImage.

[11]  Arjun K. Bansal,et al.  Relationships among low-frequency local field potentials, spiking activity, and three-dimensional reach and grasp kinematics in primary motor and ventral premotor cortices. , 2011, Journal of neurophysiology.

[12]  J. Wolpaw,et al.  Decoding flexion of individual fingers using electrocorticographic signals in humans , 2009, Journal of neural engineering.

[13]  M. Schieber Constraints on somatotopic organization in the primary motor cortex. , 2001, Journal of neurophysiology.

[14]  W. Penfield,et al.  SOMATIC MOTOR AND SENSORY REPRESENTATION IN THE CEREBRAL CORTEX OF MAN AS STUDIED BY ELECTRICAL STIMULATION , 1937 .

[15]  M. E. Spencer,et al.  Error bounds for EEG and MEG dipole source localization. , 1993, Electroencephalography and clinical neurophysiology.

[16]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[17]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[18]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[19]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[20]  M. Sams,et al.  Classification of single MEG trials related to left and right index finger movements , 2006, Clinical Neurophysiology.

[21]  John P. Donoghue,et al.  ventral premotor cortices reach and grasp kinematics in primary motor and potentials, spiking activity, and three-dimensional Relationships among low-frequency local field , 2011 .

[22]  Hans-Jochen Heinze,et al.  Predicting the recognition of natural scenes from single trial MEG recordings of brain activity , 2000, NeuroImage.

[23]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[24]  P. Haggard,et al.  On the relation between brain potentials and the awareness of voluntary movements , 1999, Experimental Brain Research.

[25]  B. Rockstroh,et al.  Slow potentials of the cerebral cortex and behavior. , 1990, Physiological reviews.

[26]  Dragan F. Dimitrov,et al.  Cortical Representation of Ipsilateral Arm Movements in Monkey and Man , 2009, The Journal of Neuroscience.

[27]  Michael Pauen,et al.  Analysis of a choice-reaction task yields a new interpretation of Libet's experiments. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[29]  A. Georgopoulos,et al.  Magnetoencephalographic signals predict movement trajectory in space , 2005, Experimental Brain Research.

[30]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[31]  J. Wolpaw,et al.  Decoding two-dimensional movement trajectories using electrocorticographic signals in humans , 2007, Journal of neural engineering.

[32]  L. Deecke,et al.  Magnetic fields of the human brain accompanying voluntary movement: Bereitschaftsmagnetfeld , 2004, Experimental Brain Research.

[33]  Dimitrios Pantazis,et al.  Coherent neural representation of hand speed in humans revealed by MEG imaging , 2007, Proceedings of the National Academy of Sciences.

[34]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[35]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[36]  Nitish V. Thakor,et al.  Cortical decoding of individual finger and wrist kinematics for an upper-limb neuroprosthesis , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Robert T. Knight,et al.  Hemicraniectomy: A New Model for Human Electrophysiology with High Spatio-temporal Resolution , 2010, Journal of Cognitive Neuroscience.

[38]  C. Mehring,et al.  Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials , 2005, The Journal of Neuroscience.

[39]  N. Thakor,et al.  Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand , 2010, Journal of neural engineering.

[40]  R. Hari,et al.  Spatial resolution of neuromagnetic records: theoretical calculations in a spherical model. , 1988, Electroencephalography and clinical neurophysiology.

[41]  D. Cheyne,et al.  Spatiotemporal mapping of cortical activity accompanying voluntary movements using an event‐related beamforming approach , 2006, Human brain mapping.

[42]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. , 1998, Brain : a journal of neurology.

[43]  Michael Scherg,et al.  Functional imaging and localization of electromagnetic brain activity , 2005, Brain Topography.

[44]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[45]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[46]  P. Mitra,et al.  Analysis of dynamic brain imaging data. , 1998, Biophysical journal.