Ensemble of classifiers applied to motor imagery task classification for BCI applications

Brain Computer Interfaces allow the interaction between a person and their environment using signals extracted directly from the brain. One of the most common non-invasive methods of brain signal acquisition is the electroencephalography (EEG). An EEG based BCI system generally involves four steps: preprocessing, feature extraction, feature selection, and classification. In order to design a real applicable BCI system, it is important to provide: good classification performance, adequate computational cost, robustness to variations of the signal between trials and between subjects, and a classifiers model that cope with highly dimensional data. Ensemble of classifiers is a learning model that, with a proper design, can satisfy those conditions, which make them a good match for a BCI application. In this paper, some ensemble of classifiers designs are evaluated and compared with other BCI approaches on three different subjects. In the proposed model, Genetic Algorithm is employed as feature selection method and Wavelet Packet Decomposition as preprocessing procedure. Four fusion methods were applied in the ensembles design, including: Majority Voting, Weighted Majority Voting, Genetic Algorithm for classifier selection and Genetic Algorithm to compute the weights for the Weighted Majority fusion method. The best results were obtained with the Weighted Majority Voting fusion method based on Genetic Algorithm.

[1]  Ricardo Tanscheit,et al.  Mental Tasks Classification for a Noninvasive BCI Application , 2009, ICANN.

[2]  Cuntai Guan,et al.  A Large Clinical Study on the Ability of Stroke Patients to Use an EEG-Based Motor Imagery Brain-Computer Interface , 2011, Clinical EEG and neuroscience.

[3]  V. Samar,et al.  Wavelet Analysis of Neuroelectric Waveforms: A Conceptual Tutorial , 1999, Brain and Language.

[4]  Rabab K. Ward,et al.  Comparing Different Classifiers in Sensory Motor Brain Computer Interfaces , 2015, PloS one.

[5]  Aureli Soria-Frisch,et al.  A Critical Review on the Usage of Ensembles for BCI , 2012 .

[6]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[7]  Wei-Yen Hsu,et al.  Enhancing the Performance of Motor Imagery EEG Classification Using Phase Features , 2015, Clinical EEG and neuroscience.

[8]  Yan Wu,et al.  A novel method for motor imagery EEG adaptive classification based biomimetic pattern recognition , 2013, Neurocomputing.

[9]  Anatole Lécuyer,et al.  Classifying EEG for brain computer interfaces using Gaussian processes , 2008, Pattern Recognit. Lett..

[10]  Huan Liu,et al.  Feature Selection: An Ever Evolving Frontier in Data Mining , 2010, FSDM.

[11]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[12]  Sang-Hong Lee,et al.  Minimum Feature Selection for Epileptic Seizure Classification using Wavelet-based Feature Extraction and a Fuzzy Neural Network , 2014 .

[13]  Amit Konar,et al.  Performance analysis of ensemble methods for multi-class classification of motor imagery EEG signal , 2014, Proceedings of The 2014 International Conference on Control, Instrumentation, Energy and Communication (CIEC).

[14]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[15]  M. Sams,et al.  EEG and MEG brain-computer interface for tetraplegic patients , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Fabien Lotte,et al.  The Use of Fuzzy Inference Systems for Classification in EEG-based Brain-Computer Interfaces , 2006 .

[17]  Amr Mohamed,et al.  Ensemble Classifier for Epileptic Seizure Detection for Imperfect EEG Data , 2015, TheScientificWorldJournal.

[18]  Alimed Celecia Ramos,et al.  Feature Selection methods applied to Motor Imagery task classification , 2016, 2016 IEEE Latin American Conference on Computational Intelligence (LA-CCI).

[19]  Chiew Tong Lau,et al.  A Study on the impact of spectral variability in brain-computer interface , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[20]  Abdulhamit Subasi,et al.  Classification of EEG signals using neural network and logistic regression , 2005, Comput. Methods Programs Biomed..

[21]  Andrés Ortiz,et al.  Classification of motor imagery tasks for BCI with multiresolution analysis and multiobjective feature selection , 2016, Biomedical engineering online.

[22]  Anatole Lécuyer,et al.  Exploring two novel features for EEG-based brain-computer interfaces: Multifractal cumulants and predictive complexity , 2010, Neurocomputing.

[23]  Nasour Bagheri,et al.  Multiple classifier system for EEG signal classification with application to brain–computer interfaces , 2012, Neural Computing and Applications.

[24]  Dong Ming,et al.  EEG oscillatory patterns and classification of sequential compound limb motor imagery , 2016, Journal of NeuroEngineering and Rehabilitation.

[25]  John Atkinson,et al.  Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers , 2016, Expert Syst. Appl..

[26]  Wei-Yen Hsu WAVELET-COHERENCE FEATURES FOR MOTOR IMAGERY EEG ANALYSIS POSTERIOR TO EOG NOISE ELIMINATION , 2012 .

[27]  Subhojit Ghosh,et al.  Statistical Wavelet Features, PCA, and SVM Based Approach for EEG Signals Classification , 2015 .

[28]  Thomas Hofmann,et al.  Aggregating Classification Accuracy across Time: Application to Single Trial EEG , 2007 .

[29]  Yan Guozheng,et al.  EEG feature extraction based on wavelet packet decomposition for brain computer interface , 2008 .

[30]  Klaus-Robert Müller,et al.  Interpretable deep neural networks for single-trial EEG classification , 2016, Journal of Neuroscience Methods.

[31]  Yuting Zhang,et al.  Comparison of classification methods on EEG signals based on wavelet packet decomposition , 2014, Neural Computing and Applications.

[32]  Francisco Sepulveda,et al.  Delta band contribution in cue based single trial classification of real and imaginary wrist movements , 2008, Medical & Biological Engineering & Computing.

[33]  A. Balbinot,et al.  A study of the Naive Bayes classifier for analyzing imaginary movement EEG signals using the Periodogram as spectral estimator , 2013, 2013 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[34]  Daubechies,et al.  Ten Lectures on Wavelets Volume 921 , 1992 .

[35]  José del R. Millán,et al.  Graz-Brain-Computer Interface: State of Research , 2007 .

[36]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[37]  DAVID R. ACHANCCARAY,et al.  Brain Computer Interface based on Electroencephalographic Signal Processing , .

[38]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Nadir Farah,et al.  From static to dynamic ensemble of classifiers selection: Application to Arabic handwritten recognition , 2012, Int. J. Knowl. Based Intell. Eng. Syst..

[40]  Dataset IIIb: Non-stationary 2-class BCI data , 2004 .

[41]  Emad A. Awada,et al.  Wavelet-Based Feature Extraction for the Analysis of EEG Signals Associated with Imagined Fists and Feet Movements , 2014, Comput. Inf. Sci..

[42]  Urbano Nunes,et al.  Trainable classifier-fusion schemes: An application to pedestrian detection , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[43]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[44]  Wei Cheng,et al.  EEG classification for motor imagery and resting state in BCI applications using multi-class Adaboost extreme learning machine. , 2016, The Review of scientific instruments.

[45]  Francesco Sergio Pisani,et al.  Combining Ensemble of Classifiers by Using Genetic Programming for Cyber Security Applications , 2015, EvoApplications.

[46]  L. Vega-Escobar,et al.  Feature extraction schemes for BCI systems , 2015, 2015 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA).

[47]  M. C. A. Korba,et al.  Comparative Analysis of Spectral Estimation Methods for Brain-Computer Interfaces , 2022 .