Employing PCA and t-statistical approach for feature extraction and classification of emotion from multichannel EEG signal

Abstract To achieve a highly efficient brain-computer interface (BCI) system regarding emotion recognition from electroencephalogram (EEG) signal, the most crucial issues are feature extractions and classifier selection. This work proposes an innovative method that hybridizes the principal component analysis (PCA) and t-statistics for feature extraction. This work contributes to successfully implement spatial PCA to reduce signal dimensionality and to select the suitable features based on the t-statistical inferences among the classes. The proposed method has been applied on the SEED dataset (SJTU Emotion EEG Dataset) that yielded significant channels and features for getting higher classification accuracy. With extracted features, four classifiers– support vector machine (SVM), artificial neural network (ANN), linear discriminant analysis (LDA), and k-nearest neighbor (kNN) method were applied to classify the emotional states. The classifiers showed slightly different classification accuracies compared to each other. ANN and SVM showed the highest classification accuracy (86.57 ± 4.08 and 85.85 ± 5.72) in case of subject dependent approach. On the other hand, the proposed method provides 84.3% and 77.1% classification accuracy with ANN and SVM, respectively in case of subject independent approach. Eventually, the proposed method and its outcomes demonstrate that this proposal is better than the several existing methods in emotion recognition.

[1]  F. La Foresta,et al.  Automatic Artifact Rejection From Multichannel Scalp EEG by Wavelet ICA , 2012, IEEE Sensors Journal.

[2]  Arun Kumar Sangaiah,et al.  An Approach to EEG Based Emotion Recognition and Classification Using Kernel Density Estimation , 2015 .

[3]  Q. M. Jonathan Wu,et al.  EEG-Based Emotion Recognition Using Hierarchical Network With Subnetwork Nodes , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[4]  AbdiHervé,et al.  Principal Component Analysis , 2010, Essentials of Pattern Recognition.

[5]  Thierry Pun,et al.  A channel selection method for EEG classification in emotion assessment based on synchronization likelihood , 2007, 2007 15th European Signal Processing Conference.

[6]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[7]  Olga Sourina,et al.  Real-time EEG-based emotion recognition for music therapy , 2011, Journal on Multimodal User Interfaces.

[8]  Yaacob Sazali,et al.  Classification of human emotion from EEG using discrete wavelet transform , 2010 .

[9]  Longlian Zhao,et al.  Application of Multiple Classifier Fusion in the Discriminant Analysis of near Infrared Spectroscopy for Agricultural Products , 2016 .

[10]  Francesco Carlo Morabito,et al.  Enhanced Automatic Wavelet Independent Component Analysis for Electroencephalographic Artifact Removal , 2014, Entropy.

[11]  H. Abdi,et al.  Principal component analysis , 2010 .

[12]  Mohiuddin Ahmad,et al.  EEG based Brain Alertness Monitoring by Statistical and Artificial Neural Network Approach , 2019 .

[13]  A. Yli-Hankala,et al.  Time‐frequency balanced spectral entropy as a measure of anesthetic drug effect in central nervous system during sevoflurane, propofol, and thiopental anesthesia , 2004, Acta anaesthesiologica Scandinavica.

[14]  Bhavna P Harne,et al.  Higuchi Fractal Dimension Analysis of EEG Signal before and after OM Chanting to Observe Overall Effect on Brain , 2014 .

[15]  Youjun Li,et al.  Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks , 2017 .

[16]  Ying Zhang,et al.  An Efficient Feature Selection Strategy Based on Multiple Support Vector Machine Technology with Gene Expression Data , 2018, BioMed research international.

[17]  Bao-Liang Lu,et al.  Identifying Stable Patterns over Time for Emotion Recognition from EEG , 2016, IEEE Transactions on Affective Computing.

[18]  Bao-Liang Lu,et al.  EEG-based emotion recognition using domain adaptation network , 2017, 2017 International Conference on Orange Technologies (ICOT).

[19]  Md. Foisal Hossain,et al.  An Advanced Algorithm Combining SVM and ANN Classifiers to Categorize Tumor with Position from Brain MRI Images , 2018 .

[20]  Yang Wang,et al.  Applications of Support Vector Machine (SVM) Learning in Cancer Genomics. , 2018, Cancer genomics & proteomics.

[21]  Amin Mahnam,et al.  Development of a practical high frequency brain–computer interface based on steady-state visual evoked potentials using a single channel of EEG , 2018 .

[22]  Bin He,et al.  Classifying EEG-based motor imagery tasks by means of time–frequency synthesized spatial patterns , 2004, Clinical Neurophysiology.

[23]  I. Jolliffe Principal Component Analysis , 2002 .

[24]  Keum-Shik Hong,et al.  Online binary decision decoding using functional near-infrared spectroscopy for the development of brain–computer interface , 2014, Experimental Brain Research.

[25]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[26]  Vladimir Bostanov,et al.  BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram , 2004, IEEE Transactions on Biomedical Engineering.

[27]  Roberto Antonio Vázquez,et al.  Classification of EEG signals using fractal dimension features and artificial neural networks , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[28]  Soraia M. Alarcão,et al.  Emotions Recognition Using EEG Signals: A Survey , 2019, IEEE Transactions on Affective Computing.

[29]  ByoungChul Ko,et al.  A Brief Review of Facial Emotion Recognition Based on Visual Information , 2018, Sensors.

[30]  Christos D. Katsis,et al.  Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Wenming Zheng,et al.  Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[32]  Chen Yujia,et al.  A Fisher’s Criterion-Based Linear Discriminant Analysis for Predicting the Critical Values of Coal and Gas Outbursts Using the Initial Gas Flow in a Borehole , 2017 .

[33]  Bangjun Lei,et al.  Classification, Parameter Estimation and State Estimation: An Engineering Approach Using MATLAB, 2nd Edition , 2017 .

[34]  Melanie Hartmann Spikes Exploring The Neural Code Computational Neuroscience , 2016 .

[35]  Li Xin,et al.  An Improved Multi-Scale Entropy Algorithm in Emotion EEG Features Extraction , 2017 .

[36]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[37]  Anton Nijholt,et al.  Emotional brain-computer interfaces , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[38]  R. Ramírez,et al.  EEG-Based Analysis of the Emotional Effect of Music Therapy on Palliative Care Cancer Patients , 2018, Front. Psychol..