Performance enhancement of mental task classification using EEG signal: a study of multivariate feature selection methods

In the recent years, the research community has shown interest in the development of brain–computer interface applications which assist physically challenged people to communicate with their brain electroencephalogram (EEG) signal. Representation of these EEG signals for mental task classification in terms of relevant features is important to achieve higher performance in terms of accuracy and computation time. For feature extraction from the EEG, empirical mode decomposition and wavelet transform are more appropriate as they are suitable for the analysis of non-linear and non-stationary time series signals. However, the size of the feature vector obtained from them is huge and may hinder the performance of mental task classification. To obtain a minimal set of relevant and non-redundant features for classification, six popular multivariate filter methods have been investigated which are based on different criteria: distance measure, causal effect and mutual information. Experimental results demonstrate that the classification accuracy improves while the computation time reduces considerably with the use of each of the six multivariate feature selection methods. Among all the combinations of feature extraction and selection methods that are investigated, the combination of wavelet transform and linear regression performs the best. Ranking analysis and statistical tests are also performed to validate the empirical results.

[1]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[2]  M J Stokes,et al.  EEG-based communication: a pattern recognition approach. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  Ah Chung Tsoi,et al.  Classification of EEG signals using the wavelet transform , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[4]  Jean-Philippe Vert,et al.  The Influence of Feature Selection Methods on Accuracy, Stability and Interpretability of Molecular Signatures , 2011, PloS one.

[5]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.

[6]  Izabela Rejer,et al.  Genetic algorithm and forward method for feature selection in EEG feature space , 2013 .

[7]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[8]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[9]  Michèle Basseville,et al.  Sequential segmentation of nonstationary digital signals using spectral analysis , 1983, Inf. Sci..

[10]  R Kahavi,et al.  Wrapper for feature subset selection , 1997 .

[11]  Edwin Lughofer,et al.  A Comparison of Variable Selection Methods with the Main Focus on Orthogonalization , 2004 .

[12]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[13]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[14]  Hasan Ocak,et al.  Automatic detection of epileptic seizures in EEG using discrete wavelet transform and approximate entropy , 2009, Expert Syst. Appl..

[15]  Michel Verleysen,et al.  EEG feature selection using mutual information and support vector machine: A comparative analysis , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[17]  Heba M. Lakany,et al.  Understanding intention of movement from electroencephalograms , 2007, Expert Syst. J. Knowl. Eng..

[18]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[19]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Wei-Yen Hsu,et al.  EEG-based motor imagery analysis using weighted wavelet transform features , 2009, Journal of Neuroscience Methods.

[23]  G. Pfurtscheller,et al.  Detection of movement-related patterns in ongoing single-channel electrocorticogram , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Irena Koprinska Feature Selection for Brain-Computer Interfaces , 2009, PAKDD Workshops.

[25]  Elif Derya Übeyli,et al.  Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: A pilot study , 2008, Digit. Signal Process..

[26]  R. Iman,et al.  Approximations of the critical region of the fbietkan statistic , 1980 .

[27]  Frank Y. Shih,et al.  Classification of Landsat remote sensing images by a fuzzy unsupervised clustering algorithm , 1994 .

[28]  Sung-Bae Cho,et al.  Forward selection method with regression analysis for optimal gene selection in cancer classification , 2007, Int. J. Comput. Math..

[29]  Yongmin Li,et al.  On incremental and robust subspace learning , 2004, Pattern Recognit..

[30]  Walter J. Freeman,et al.  Comparison of Brain Models for Active vs. Passive Perception , 1999, Inf. Sci..

[31]  Pablo F. Diez,et al.  Application of the empirical mode decomposition to the extraction of features from EEG signals for mental task classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[33]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[34]  Amit Konar,et al.  Automatic feature selection of motor imagery EEG signals using differential evolution and learning automata , 2013, Medical & Biological Engineering & Computing.

[35]  S. Krishnan,et al.  Application of Empirical Mode Decomposition and Teager energy operator to EEG signals for mental task classification , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[36]  Rebeca Corralejo,et al.  Feature selection using a genetic algorithm in a motor imagery-based Brain Computer Interface , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Dario Farina,et al.  Comparison of feature selection and classification methods for a brain–computer interface driven by non-motor imagery , 2010, Medical & Biological Engineering & Computing.

[38]  Ram Shankar Pathak,et al.  The Wavelet Transform , 2009 .

[39]  Z. Keirn,et al.  A new mode of communication between man and his surroundings , 1990, IEEE Transactions on Biomedical Engineering.

[40]  Vladimir Bostanov,et al.  BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram , 2004, IEEE Transactions on Biomedical Engineering.

[41]  Edwin Lughofer,et al.  On-line incremental feature weighting in evolving fuzzy classifiers , 2011, Fuzzy Sets Syst..

[42]  S. Voloshynovskiy,et al.  EEG-Based Synchronized Brain-Computer Interfaces: A Model for Optimizing the Number of Mental Tasks , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  F Babiloni,et al.  Linear classification of low-resolution EEG patterns produced by imagined hand movements. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[44]  G Pfurtscheller,et al.  Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[45]  R. K. Agrawal,et al.  Performance evaluation of weights selection schemes for linear combination of multiple forecasts , 2012, Artificial Intelligence Review.

[46]  Fikret S. Gürgen,et al.  A feature selection method based on kernel canonical correlation analysis and the minimum Redundancy-Maximum Relevance filter method , 2012, Expert Syst. Appl..

[47]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[48]  Yaacob Sazali,et al.  Classification of human emotion from EEG using discrete wavelet transform , 2010 .

[49]  M. Sams,et al.  EEG and MEG brain-computer interface for tetraplegic patients , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[51]  Pedro J. García-Laencina,et al.  Efficient Automatic Selection and Combination of EEG Features in Least Squares Classifiers for Motor Imagery Brain-Computer Interfaces , 2013, Int. J. Neural Syst..

[52]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[53]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[54]  R. K. Agrawal,et al.  Relevant Feature Selection from EEG Signal for Mental Task Classification , 2012, PAKDD.

[55]  Steven J. Schiff,et al.  Feature selection on movement imagery discrimination and attention detection , 2010, Medical & Biological Engineering & Computing.

[56]  C.W. Anderson,et al.  Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks , 1998, IEEE Transactions on Biomedical Engineering.

[57]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[58]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .