Aggregation of Sparse Linear Discriminant analyses for Event-Related potential Classification in Brain-Computer Interface

Two main issues for event-related potential (ERP) classification in brain-computer interface (BCI) application are curse-of-dimensionality and bias-variance tradeoff, which may deteriorate classification performance, especially with insufficient training samples resulted from limited calibration time. This study introduces an aggregation of sparse linear discriminant analyses (ASLDA) to overcome these problems. In the ASLDA, multiple sparse discriminant vectors are learned from differently l1-regularized least-squares regressions by exploiting the equivalence between LDA and least-squares regression, and are subsequently aggregated to form an ensemble classifier, which could not only implement automatic feature selection for dimensionality reduction to alleviate curse-of-dimensionality, but also decrease the variance to improve generalization capacity for new test samples. Extensive investigation and comparison are carried out among the ASLDA, the ordinary LDA and other competing ERP classification algorithms, based on different three ERP datasets. Experimental results indicate that the ASLDA yields better overall performance for single-trial ERP classification when insufficient training samples are available. This suggests the proposed ASLDA is promising for ERP classification in small sample size scenario to improve the practicability of BCI.

[1]  H. Adeli,et al.  A spatio-temporal wavelet-chaos methodology for EEG-based diagnosis of Alzheimer's disease , 2008, Neuroscience Letters.

[2]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[3]  Marc M. Van Hulle,et al.  Head-Centric Disparity and Epipolar Geometry Estimation from a Population of Binocular Energy Neurons , 2012, Int. J. Neural Syst..

[4]  Tapani Ristaniemi,et al.  Single-Trial Based Independent Component Analysis on mismatch Negativity in Children , 2010, Int. J. Neural Syst..

[5]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[6]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Cheolsoo Park,et al.  Classification of Motor Imagery BCI Using Multivariate Empirical Mode Decomposition , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  H. Adeli,et al.  of Depressive Women and Men Spatiotemporal Analysis of Relative Convergence of EEGs Reveals Differences Between Brain Dynamics , 2013 .

[9]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[10]  Jieping Ye,et al.  Least squares linear discriminant analysis , 2007, ICML '07.

[11]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[12]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[13]  Marc M. Van Hulle,et al.  Multichannel Decoding for Phase-Coded SSVEP Brain-Computer Interface , 2012, Int. J. Neural Syst..

[14]  Hojjat Adeli,et al.  Fuzzy Synchronization Likelihood with Application to Attention-Deficit/Hyperactivity Disorder , 2011, Clinical EEG and neuroscience.

[15]  K. Strimmer,et al.  Statistical Applications in Genetics and Molecular Biology A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics , 2011 .

[16]  Wei-Yen Hsu,et al.  Continuous EEG Signal Analysis for Asynchronous BCI Application , 2011, Int. J. Neural Syst..

[17]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[18]  Aleksandar Neskovic,et al.  Artificial Neural Network Based Approach to EEG Signal Simulation , 2012, Int. J. Neural Syst..

[19]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[20]  Haiping Lu,et al.  Uncorrelated Multilinear Discriminant Analysis With Regularization and Aggregation for Tensor Object Recognition , 2009, IEEE Transactions on Neural Networks.

[21]  Thomas Villmann,et al.  Regularization in Matrix Relevance Learning , 2010, IEEE Transactions on Neural Networks.

[22]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[23]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[24]  Francisco J. Pelayo,et al.  An auditory Brain-Computer Interface with Accuracy Prediction , 2012, Int. J. Neural Syst..

[25]  Heung-No Lee,et al.  Sparse representation-based classification scheme for motor imagery-based brain–computer interface systems , 2012, Journal of neural engineering.

[26]  Pedro J. García-Laencina,et al.  Efficient feature selection and linear discrimination of EEG signals , 2013, Neurocomputing.

[27]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[28]  Heikki Lyytinen,et al.  Benefits of Multi-Domain Feature of mismatch Negativity Extracted by Non-Negative Tensor Factorization from EEG Collected by Low-Density Array , 2012, Int. J. Neural Syst..

[29]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[30]  Vladimir Bostanov,et al.  BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram , 2004, IEEE Transactions on Biomedical Engineering.

[31]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[32]  Jonathan R Wolpaw,et al.  A comparison of regression techniques for a two-dimensional sensorimotor rhythm-based brain–computer interface , 2010, Journal of neural engineering.

[33]  H. Adeli,et al.  Fractality analysis of frontal brain in major depressive disorder. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[36]  H. Adeli,et al.  Improved visibility graph fractality with application for the diagnosis of Autism Spectrum Disorder , 2012 .

[37]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[38]  Konstantinos N. Plataniotis,et al.  Ensemble-based discriminant learning with boosting for face recognition , 2006, IEEE Transactions on Neural Networks.

[39]  Malek Adjouadi,et al.  A New Parametric Feature Descriptor for the Classification of Epileptic and Control EEG Records in Pediatric Population , 2012, Int. J. Neural Syst..

[40]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[41]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[42]  Nicole Krämer,et al.  Time Domain Parameters as a feature for EEG-based Brain-Computer Interfaces , 2009, Neural Networks.

[43]  H. Adeli,et al.  Visibility graph similarity: A new measure of generalized synchronization in coupled dynamic systems , 2012 .

[44]  H. Adeli,et al.  Graph Theoretical Analysis of Organization of Functional Brain Networks in ADHD , 2012, Clinical EEG and neuroscience.

[45]  Hojjat Adeli,et al.  Wavelet-Synchronization Methodology: A New Approach for EEG-Based Diagnosis of ADHD , 2010, Clinical EEG and neuroscience.

[46]  Hojjat Adeli,et al.  Regularization neural network for construction cost estimation , 1998 .

[47]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[49]  AdeliHojjat,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009 .

[50]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[51]  Hojjat Adeli,et al.  Feature Extraction for Traffic Incident Detection Using Wavelet Transform and Linear Discriminant Analysis , 2000 .

[52]  Bogdan Codres,et al.  Nonlinear System Identification and Control Based on Modular Neural Networks , 2011, Int. J. Neural Syst..

[53]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[54]  H. Adeli,et al.  Intrahemispheric, interhemispheric, and distal EEG coherence in Alzheimer’s disease , 2011, Clinical Neurophysiology.

[55]  H. Adeli,et al.  Brain-computer interface technologies: from signal to action , 2013, Reviews in the neurosciences.

[56]  Robert P. W. Duin,et al.  Bagging, Boosting and the Random Subspace Method for Linear Classifiers , 2002, Pattern Analysis & Applications.

[57]  U. Rajendra Acharya,et al.  Application of Non-Linear and Wavelet Based Features for the Automated Identification of Epileptic EEG signals , 2012, Int. J. Neural Syst..

[58]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[59]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[60]  H. Adeli,et al.  Wavelet Coherence Model for Diagnosis of Alzheimer Disease , 2012, Clinical EEG and neuroscience.

[61]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[62]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[63]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[64]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[65]  Xingyu Wang,et al.  Spatial-Temporal Discriminant Analysis for ERP-Based Brain-Computer Interface , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[66]  Andrzej Cichocki,et al.  Nonnegative Tensor Factorization for Continuous EEG Classification , 2007, Int. J. Neural Syst..

[67]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[68]  Tapani Ristaniemi,et al.  Multi-Domain Feature Extraction for Small Event-Related potentials through Nonnegative Multi-Way Array Decomposition from Low Dense Array EEG , 2013, Int. J. Neural Syst..

[69]  Jie Li,et al.  Design of assistive Wheelchair System directly Steered by Human Thoughts , 2013, Int. J. Neural Syst..

[70]  Yuanqing Li,et al.  An Extended EM Algorithm for Joint Feature Extraction and Classification in Brain-Computer Interfaces , 2006, Neural Computation.

[71]  Wei-Yen Hsu,et al.  Single-Trial Motor Imagery Classification using Asymmetry Ratio, phase Relation, Wavelet-Based Fractal, and their Selected Combination , 2013, Int. J. Neural Syst..

[72]  Hojjat Adeli,et al.  Enhanced probabilistic neural network with local decision circles: A robust classifier , 2010, Integr. Comput. Aided Eng..

[73]  Hojjat Adeli,et al.  Fuzzy Synchronization Likelihood-wavelet methodology for diagnosis of autism spectrum disorder , 2012, Journal of Neuroscience Methods.

[74]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[75]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[76]  Emanuel Donchin,et al.  A P 300-based brain – computer interface : Initial tests by ALS patients Eric , 2006 .

[77]  Hojjat Adeli,et al.  New diagnostic EEG markers of the Alzheimer’s disease using visibility graph , 2010, Journal of Neural Transmission.

[78]  Dominique M. Durand,et al.  A Novel Electrical Stimulation Paradigm for the Suppression of epileptiform Activity in an in vivo Model of mesial Temporal Lobe Status Epilepticus , 2012, Int. J. Neural Syst..

[79]  Hojjat Adeli,et al.  Probabilistic neural networks for diagnosis of Alzheimer's disease using conventional and wavelet coherence , 2011, Journal of Neuroscience Methods.

[80]  Hojjat Adeli,et al.  Fractality and a Wavelet-Chaos-Neural Network Methodology for EEG-Based Diagnosis of Autistic Spectrum Disorder , 2010, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[81]  Hojjat Adeli,et al.  Functional community analysis of brain: A new approach for EEG-based investigation of the brain pathology , 2011, NeuroImage.