Recognizing Motor Imagery Tasks Using Deep Multi-Layer Perceptrons

A brain-computer interface provides individuals with a way to control a computer. However, most of these interfaces remain mostly utilized in research laboratories due to the absence of certainty and accuracy in the proposed systems. In this work, we acquired our own dataset from seven able-bodied subjects and used Deep Multi-Layer Perceptrons to classify motor imagery encephalography signals into binary (Rest vs Imagined and Left vs Right) and ternary classes (Rest vs Left vs Right). These Deep Multi-Layer Perceptrons were fed with power spectral features computed with the Welch’s averaged modified periodogram method. The proposed architectures outperformed the accuracy achieved by the state-of-the-art for classifying motor imagery bioelectrical brain signals obtaining 88.03%, 85.92% and 79.82%, respectively, and an enhancement of 11.68% on average over the commonly used Support Vector Machines.

[1]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[2]  Christiane,et al.  WORLD MEDICAL ASSOCIATION DECLARATION OF HELSINKI: Ethical Principles for Medical Research Involving Human Subjects , 2001, Journal of postgraduate medicine.

[3]  Dean J Krusienski,et al.  Brain-computer interfaces in medicine. , 2012, Mayo Clinic proceedings.

[4]  Wolzt,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2003, The Journal of the American College of Dentists.

[5]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[6]  Hubert Cecotti,et al.  Convolutional Neural Network with embedded Fourier Transform for EEG classification , 2008, 2008 19th International Conference on Pattern Recognition.

[7]  Juan Humberto Sossa Azuela,et al.  Comparing Deep and Dendrite Neural Networks: A Case Study , 2017, MCPR.

[8]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[9]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[10]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[11]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[12]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[13]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[14]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.

[15]  Lianghua He,et al.  A Deep Learning Method for Classification of EEG Data Based on Motor Imagery , 2014, ICIC.

[16]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[17]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[18]  Geng Liu,et al.  Algorithm and Data Optimization Techniques for Scaling to Massively Threaded Systems , 2012, Computer.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Sebastian Stober,et al.  Using Convolutional Neural Networks to Recognize Rhythm Stimuli from Electroencephalography Recordings , 2014, NIPS.

[21]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  G. Berns,et al.  BAD TO WORSE , 1975, The Lancet.

[23]  Brendan Z. Allison,et al.  Brain-Computer Interfaces: Revolutionizing Human-Computer Interaction , 2013 .

[24]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[25]  Zhang Weidong,et al.  Deep learning EEG response representation for brain computer interface , 2015, 2015 34th Chinese Control Conference (CCC).

[26]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[27]  N. Birbaumer.  Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[28]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[29]  Ajith Abraham,et al.  An Empirical Comparison of Kernel Selection for Support Vector Machines , 2002, HIS.

[30]  Antonio Jimeno-Yepes,et al.  Decoding EEG and LFP signals using deep learning: heading TrueNorth , 2016, Conf. Computing Frontiers.

[31]  Anton Nijholt,et al.  Preface (to: Towards Practical Brain-Computer Interfaces) , 2012 .

[32]  Russ Greiner,et al.  Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals , 2016, Artif. Intell. Res..

[33]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[34]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[35]  Berenice Gudiño-Mendoza,et al.  Classification of Motor States from Brain Rhythms Using Lattice Neural Networks , 2016, MCPR.

[36]  Jonathan Becedas,et al.  Brain–Machine Interfaces: Basis and Advances , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[37]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[38]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[39]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[40]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[41]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[42]  M. Hallett,et al.  Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries , 2008, Clinical Neurophysiology.

[43]  Berenice Gudiño-Mendoza,et al.  Dendrite morphological neural networks for motor task recognition from electroencephalographic signals , 2018, Biomed. Signal Process. Control..

[44]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[45]  Juan Humberto Sossa Azuela,et al.  Classification of Hand Movements from Non-invasive Brain Signals Using Lattice Neural Networks with Dendritic Processing , 2015, MCPR.

[46]  Yan Peng,et al.  Scorpion Venom Heat-Resistant Peptide (SVHRP) Enhances Neurogenesis and Neurite Outgrowth of Immature Neurons in Adult Mice by Up-Regulating Brain-Derived Neurotrophic Factor (BDNF) , 2014, PloS one.

[47]  Anton Nijholt,et al.  Towards Practical Brain-Computer Interfaces: Bridging the Gap from Research to Real-World Applications , 2012 .

[48]  Ruimin Wang,et al.  Classification of Four-Class Motor Imagery Employing Single-Channel Electroencephalography , 2014, PloS one.

[49]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[50]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.