Decoding Individual Finger Movements from One Hand Using Human EEG Signals

Brain computer interface (BCI) is an assistive technology, which decodes neurophysiological signals generated by the human brain and translates them into control signals to control external devices, e.g., wheelchairs. One problem challenging noninvasive BCI technologies is the limited control dimensions from decoding movements of, mainly, large body parts, e.g., upper and lower limbs. It has been reported that complicated dexterous functions, i.e., finger movements, can be decoded in electrocorticography (ECoG) signals, while it remains unclear whether noninvasive electroencephalography (EEG) signals also have sufficient information to decode the same type of movements. Phenomena of broadband power increase and low-frequency-band power decrease were observed in EEG in the present study, when EEG power spectra were decomposed by a principal component analysis (PCA). These movement-related spectral structures and their changes caused by finger movements in EEG are consistent with observations in previous ECoG study, as well as the results from ECoG data in the present study. The average decoding accuracy of 77.11% over all subjects was obtained in classifying each pair of fingers from one hand using movement-related spectral changes as features to be decoded using a support vector machine (SVM) classifier. The average decoding accuracy in three epilepsy patients using ECoG data was 91.28% with the similarly obtained features and same classifier. Both decoding accuracies of EEG and ECoG are significantly higher than the empirical guessing level (51.26%) in all subjects (p<0.05). The present study suggests the similar movement-related spectral changes in EEG as in ECoG, and demonstrates the feasibility of discriminating finger movements from one hand using EEG. These findings are promising to facilitate the development of BCIs with rich control signals using noninvasive technologies.

[1]  Charles S. Myers,et al.  On reaction times. , 1909 .

[2]  G. Pfurtscheller,et al.  Event-related cortical desynchronization detected by power measurements of scalp EEG. , 1977, Electroencephalography and clinical neurophysiology.

[3]  R. Zahler.  Principles of Neurobiological Signal Analysis , 1979, The Yale Journal of Biology and Medicine.

[4]  J. Fermaglich.  Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[5]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[6]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[7]  T S Kuo,et al.  Real-time implementation of electromyogram pattern recognition as a control command of man-machine interface. , 1996, Medical engineering & physics.

[8]  J F Soechting,et al.  Matching object size by controlling finger span and hand shape. , 1997, Somatosensory & motor research.

[9]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[10]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[11]  M. Peters,et al.  Volume conduction effects in EEG and MEG. , 1998, Electroencephalography and clinical neurophysiology.

[12]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..

[16]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[17]  Mohammad Hassan Moradi,et al.  Evaluation of the forearm EMG signal features for the control of a prosthetic hand. , 2003, Physiological measurement.

[18]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[19]  Andrew B Schwartz,et al.  Cortical neural prosthetics. , 2004, Annual review of neuroscience.

[20]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[21]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[22]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Gabriel Curio,et al.  MACHINE LEARNING TECHNIQUES FOR BRAIN-COMPUTER INTERFACES , 2004 .

[24]  Xiaorong Gao,et al.  Classification of single-trial electroencephalogram during finger movement , 2004, IEEE Trans. Biomed. Eng..

[25]  Martha Flanders,et al.  Flexibility and Repeatability of Finger Movements During Typing: Analysis of Multiple Degrees of Freedom , 1997, Journal of Computational Neuroscience.

[26]  Bernhard Schölkopf,et al.  Methods Towards Invasive Human Brain Computer Interfaces , 2004, NIPS.

[27]  Soo-Young Lee,et al.  Brain–computer interface using fMRI: spatial navigation by thoughts , 2004, Neuroreport.

[28]  E.J. Park,et al.  Design of an artificial muscle actuated finger towards biomimetic prosthetic hands , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[29]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[30]  José del R. Millán,et al.  Very high frequency oscillations (VHFO) as a predictor of movement intentions , 2006, NeuroImage.

[31]  J. Donoghue,et al.  Sensors for brain-computer interfaces , 2006, IEEE Engineering in Medicine and Biology Magazine.

[32]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[33]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[34]  G. Schalk,et al.  ECoG factors underlying multimodal control of a brain-computer interface , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  N. Birbaumer.  Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[36]  M. Sams,et al.  Classification of single MEG trials related to left and right index finger movements , 2006, Clinical Neurophysiology.

[37]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[38]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Niels Birbaumer,et al.  fMRI Brain-Computer Interface: A Tool for Neuroscientific Research and Treatment , 2007, Comput. Intell. Neurosci..

[40]  J. Wolpaw,et al.  Decoding two-dimensional movement trajectories using electrocorticographic signals in humans , 2007, Journal of neural engineering.

[41]  Dan Wu,et al.  Combining Spatial Filters for the Classification of Single-Trial EEG in a Finger Movement Task , 2007, IEEE Transactions on Biomedical Engineering.

[42]  Mark Hallett,et al.  Exploration of computational methods for classification of movement intention during human voluntary movement from single trial EEG , 2007, Clinical Neurophysiology.

[43]  R.P.N. Rao,et al.  Finger Movement Classification for an Electrocorticographic BCI , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[44]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[45]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[46]  Konrad Paul Kording,et al.  The statistics of natural hand movements , 2008, Experimental Brain Research.

[47]  Mikko Sams,et al.  Online Classification of Single EEG Trials During Finger Movements , 2008, IEEE Transactions on Biomedical Engineering.

[48]  Jeffrey G. Ojemann,et al.  Electrocorticographic spectral changes associated with ipsilateral individual finger and whole hand movement , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[50]  M. Hallett,et al.  Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries , 2008, Clinical Neurophysiology.

[51]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[52]  Andreas Schulze-Bonhage,et al.  Movement related activity in the high gamma range of the human EEG , 2008, NeuroImage.

[53]  Rajesh P. N. Rao,et al.  Generalized Features for Electrocorticographic BCIs , 2008, IEEE Transactions on Biomedical Engineering.

[54]  Rajesh P. N. Rao,et al.  Classification of contralateral and ipsilateral finger movements for electrocorticographic brain-computer interfaces. , 2009, Neurosurgical focus.

[55]  José Luis Contreras-Vidal,et al.  Decoding center-out hand velocity from MEG signals during visuomotor adaptation , 2009, NeuroImage.

[56]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[57]  E. Fetz,et al.  Decoupling the Cortical Power Spectrum Reveals Real-Time Representation of Individual Finger Movements in Humans , 2009, The Journal of Neuroscience.

[58]  Aleksandra Vuckovic,et al.  Non-invasive BCI: How far can we get with motor imagination? , 2009, Clinical Neurophysiology.

[59]  S. R. Liyanage,et al.  Classification of self-paced finger movements with EEG signals using neural network and evolutionary approaches , 2009, 2009 IEEE International Conference on Control and Automation.

[60]  D J Weber,et al.  Human motor cortical activity recorded with Micro-ECoG electrodes, during individual finger movements , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Xuedong Chen,et al.  Decoding human motor activity from EEG single trials for a discrete two-dimensional cursor control , 2009, Journal of neural engineering.

[62]  K. Jellinger.  Toward Brain-Computer Interfacing , 2009 .

[63]  J. Wolpaw,et al.  Decoding flexion of individual fingers using electrocorticographic signals in humans , 2009, Journal of neural engineering.

[64]  Jie Zhou,et al.  EEG-based classification for elbow versus shoulder torque intentions involving stroke subjects , 2009, Comput. Biol. Medicine.

[65]  Dario Farina,et al.  Single-trial discrimination of type and speed of wrist movements from EEG recordings , 2009, Clinical Neurophysiology.

[66]  Yusuf Uzzaman Khan,et al.  Brain-computer interface for single-trial eeg classification for wrist movement imagery using spatial filtering in the gamma band , 2010 .

[67]  N. Thakor,et al.  Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand , 2010, Journal of neural engineering.

[68]  Rajesh P. N. Rao,et al.  High gamma mapping using EEG , 2010, NeuroImage.

[69]  Mohammad Bagher Shamsollahi,et al.  Five-class finger flexion classification using ECoG signals , 2010, 2010 International Conference on Intelligent and Advanced Systems.

[70]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[71]  Rajesh P. N. Rao,et al.  Cortical activity during motor execution, motor imagery, and imagery-based online feedback , 2010, Proceedings of the National Academy of Sciences.

[72]  Lei Ding,et al.  Sparse cortical current density imaging in motor potentials induced by finger movement , 2011, Journal of neural engineering.

[73]  J. Huggins,et al.  What would brain-computer interface users want? Opinions and priorities of potential users with amyotrophic lateral sclerosis , 2011, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[74]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[75]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[76]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[77]  Tshilidzi Marwala,et al.  Single-trial EEG discrimination between wrist and finger movement imagery and execution in a sensorimotor BCI , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[78]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[79]  Ibrahim Onaran,et al.  Classification of multichannel ECoG related to individual finger movements with redundant spatial projections , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[80]  Alain Rakotomamonjy,et al.  Decoding Finger Movements from ECoG Signals Using Switching Linear Models , 2011, Front. Neurosci..

[81]  Andreas Schulze-Bonhage,et al.  Decoding natural grasp types from human ECoG , 2012, NeuroImage.

[82]  Laurent Bougrain,et al.  Decoding Finger Flexion from Band-Specific ECoG Signals in Humans , 2012, Front. Neurosci..

[83]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[84]  Hans-Jochen Heinze,et al.  Single trial discrimination of individual finger movements on one hand: A combined MEG and EEG study , 2012, NeuroImage.

[85]  Ganesh R. Naik,et al.  Computational Intelligence in Electromyography Analysis - A Perspective on Current Applications and Future Challenges , 2012 .

[86]  Zhilin Zhang,et al.  Evolving Signal Processing for Brain–Computer Interfaces , 2012, Proceedings of the IEEE.

[87]  R. K. Jain,et al.  Design and Control of an EMG Driven IPMC Based Artificial Muscle Finger , 2012 .

[88]  V V Skvortsov,et al.  Transcranial Electrostimulation in Treatment of Chronic Diffuse Liver Diseases , 2015, Meditsinskaia tekhnika.