EEG signal classification using universum support vector machine

Abstract Support vector machine (SVM) has been used widely for classification of electroencephalogram (EEG) signals for the diagnosis of neurological disorders such as epilepsy and sleep disorders. SVM shows good generalization performance for high dimensional data due to its convex optimization problem. The incorporation of prior knowledge about the data leads to a better optimized classifier. Different types of EEG signals provide information about the distribution of EEG data. To include prior information in the classification of EEG signals, we propose a novel machine learning approach based on universum support vector machine (USVM) for classification. In our approach, the universum data points are generated by selecting universum from the EEG dataset itself which are the interictal EEG signals. This removes the effect of outliers on the generation of universum data. Further, to reduce the computation time, we use our approach of universum selection with universum twin support vector machine (UTSVM) which has less computational cost in comparison to traditional SVM. For checking the validity of our proposed methods, we use various feature extraction techniques for different datasets consisting of healthy and seizure signals. Several numerical experiments are performed on the generated datasets and the results of our proposed approach are compared with other baseline methods. Our proposed USVM and proposed UTSVM show better generalization performance compared to SVM, USVM, Twin SVM (TWSVM) and UTSVM. The proposed UTSVM has achieved highest classification accuracy of 99% for the healthy and seizure EEG signals.

[1]  Jason Weston,et al.  Inference with the Universum , 2006, ICML.

[2]  Xianli Pan,et al.  A Novel Twin Support-Vector Machine With Pinball Loss , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Saeed Rahati Quchani,et al.  Evolutionary model selection in a wavelet-based support vector machine for automated seizure detection , 2011, Expert Syst. Appl..

[4]  Muhammad Tanveer,et al.  Robust energy-based least squares twin support vector machines , 2015, Applied Intelligence.

[5]  Yuan-Hai Shao,et al.  Improvements on Twin Support Vector Machines , 2011, IEEE Transactions on Neural Networks.

[6]  Yong Shi,et al.  Twin support vector machine with Universum data , 2012, Neural Networks.

[7]  Wuyang Dai,et al.  Empirical Study of the Universum SVM Learning for High-Dimensional Data , 2009, ICANN.

[8]  Yan Li,et al.  Clustering technique-based least square support vector machine for EEG signal classification , 2011, Comput. Methods Programs Biomed..

[9]  Rajeev Sharma,et al.  Classification of epileptic seizures in EEG signals based on phase space representation of intrinsic mode functions , 2015, Expert Syst. Appl..

[10]  Vladimir Cherkassky,et al.  Gender classification of human faces using inference through contradictions , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[11]  Wuyang Dai,et al.  Practical Conditions for Effectiveness of the Universum Learning , 2011, IEEE Transactions on Neural Networks.

[12]  H. Adeli,et al.  Analysis of EEG records in an epileptic patient using wavelet transform , 2003, Journal of Neuroscience Methods.

[13]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[14]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[15]  Qingshan She,et al.  Classification of Motor Imagery EEG Signals with Support Vector Machines and Particle Swarm Optimization , 2016, Comput. Math. Methods Medicine.

[16]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[17]  Ram Bilas Pachori,et al.  Classification of ictal and seizure-free EEG signals using fractional linear prediction , 2014, Biomed. Signal Process. Control..

[18]  Julius Georgiou,et al.  Detection of epileptic electroencephalogram based on Permutation Entropy and Support Vector Machines , 2012, Expert Syst. Appl..

[19]  Hasan Ocak,et al.  Optimal classification of epileptic seizures in EEG using wavelet analysis and genetic algorithm , 2008, Signal Process..

[20]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[21]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[23]  Yan Li,et al.  Classification of EEG Signals Using Sampling Techniques and Least Square Support Vector Machines , 2009, RSKT.

[24]  Lan Bai,et al.  Twin Support Vector Machine for Clustering , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Reshma Khemchandani,et al.  Applications Based on TWSVM , 2017 .

[26]  Elif Derya Übeyli,et al.  Adaptive neuro-fuzzy inference system for classification of EEG signals using wavelet coefficients , 2005, Journal of Neuroscience Methods.

[27]  Wen Long,et al.  Investor sentiment identification based on the universum SVM , 2018, Neural Computing and Applications.

[28]  Osvaldo A. Rosso,et al.  Quantitative EEG analysis of the maturational changes associated with childhood absence epilepsy , 2005 .

[29]  Mei Chen,et al.  ν-twin support vector machine with Universum data for classification , 2015, Applied Intelligence.

[30]  Muhammad Tanveer,et al.  Newton method for implicit Lagrangian twin support vector machines , 2015, Int. J. Mach. Learn. Cybern..

[31]  Nai-Yang Deng,et al.  Accurate Prediction of Translation Initiation Sites by Universum SVM , 2008 .

[32]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..

[34]  Chien-Liang Liu,et al.  Semi-Supervised Text Classification With Universum Learning , 2016, IEEE Transactions on Cybernetics.

[35]  Youxi Wu,et al.  Classification of Mental Task From EEG Signals Using Immune Feature Weighted Support Vector Machines , 2011, IEEE Transactions on Magnetics.

[36]  Changshui Zhang,et al.  Selecting Informative Universum Sample for Semi-Supervised Learning , 2009, IJCAI.

[37]  Elif Derya Übeyli,et al.  Multiclass Support Vector Machines for EEG-Signals Classification , 2007, IEEE Transactions on Information Technology in Biomedicine.

[38]  Weidong Zhou,et al.  Automatic Seizure Detection Using Wavelet Transform and SVM in Long-Term Intracranial EEG , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Ram Bilas Pachori,et al.  Classification of Seizure and Nonseizure EEG Signals Using Empirical Mode Decomposition , 2012, IEEE Transactions on Information Technology in Biomedicine.

[40]  Reshma Khemchandani,et al.  TWSVR: Regression via Twin Support Vector Machine , 2016, Neural Networks.

[41]  Daoqiang Zhang,et al.  Ensemble Universum SVM Learning for Multimodal Classification of Alzheimer's Disease , 2013, MLMI.

[42]  Muhammad Tanveer.  Robust and Sparse Linear Programming Twin Support Vector Machines , 2014, Cognitive Computation.

[43]  Ivor W. Tsang,et al.  Efficient kernel feature extraction for massive data sets , 2006, KDD '06.

[44]  Bernhard Schölkopf,et al.  An Analysis of Inference with the Universum , 2007, NIPS.

[45]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[46]  K Lehnertz,et al.  Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.