Tetromino pattern based accurate EEG emotion classification model

Nowadays, emotion recognition using electroencephalogram (EEG) signals is becoming a hot research topic. The aim of this paper is to classify emotions of EEG signals using a novel game-based feature generation function with high accuracy. Hence, a multileveled handcrafted feature generation automated emotion classification model using EEG signals is presented. A novel textural features generation method inspired by the Tetris game called Tetromino is proposed in this work. The Tetris game is one of the famous games worldwide, which uses various characters in the game. First, the EEG signals are subjected to discrete wavelet transform (DWT) to create various decomposition levels. Then, novel features are generated from the decomposed DWT sub-bands using the Tetromino method. Next, the maximum relevance minimum redundancy (mRMR) features selection method is utilized to select the most discriminative features, and the selected features are classified using support vector machine classifier. Finally, each channel's results (validation predictions) are obtained, and the mode function-based voting method is used to obtain the general results. We have validated our developed model using three databases (DREAMER, GAMEEMO, and DEAP). We have attained 100% accuracies using DREAMER and GAMEEMO datasets. Furthermore, over 99% of classification accuracy is achieved for DEAP dataset. Thus, our developed emotion detection model has yielded the best classification accuracy rate compared to the state-of-the-art techniques and is ready to be tested for clinical application after validating with more diverse datasets. Our results show the success of the presented Tetromino pattern-based EEG signal classification model validated using three public emotional EEG datasets.

[1]  Yuan Zong,et al.  Graph-Embedded Convolutional Neural Network for Image-Based EEG Emotion Recognition , 2021, IEEE Transactions on Emerging Topics in Computing.

[2]  Juan Cheng,et al.  EEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention , 2023, IEEE Transactions on Affective Computing.

[3]  Wanzeng Kong,et al.  EEG-based emotion recognition using 4D convolutional recurrent neural network , 2020, Cognitive Neurodynamics.

[4]  R. K. Tripathy,et al.  Automated accurate emotion recognition system using rhythm-specific deep convolutional neural network technique with multi-channel EEG signals , 2021, Comput. Biol. Medicine.

[5]  Xun Chen,et al.  Emotion Recognition From Multi-Channel EEG via Deep Forest , 2020, IEEE Journal of Biomedical and Health Informatics.

[6]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[7]  Moon Inder Singh,et al.  Development of a real time emotion classifier based on evoked EEG , 2017 .

[8]  Lei Wang,et al.  A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[9]  Haider Banka,et al.  Local pattern transformation based feature extraction techniques for classification of epileptic EEG signals , 2017, Biomed. Signal Process. Control..

[10]  Singapore,et al.  Emotion Classification from EEG Signals Using Time-Frequency-DWT Features and ANN , 2017 .

[11]  Seong-Whan Lee,et al.  WeDea: A New EEG-Based Framework for Emotion Recognition , 2021, IEEE Journal of Biomedical and Health Informatics.

[12]  Yimin Hou,et al.  Distinguishing Different Emotions Evoked by Music via Electroencephalographic Signals , 2019, Comput. Intell. Neurosci..

[13]  Sengul Dogan,et al.  A dynamic center and multi threshold point based stable feature extraction network for driver fatigue detection utilizing EEG signals , 2020, Cognitive Neurodynamics.

[14]  Sengul Dogan,et al.  Automated malware recognition method based on local neighborhood binary pattern , 2020, Multimedia Tools and Applications.

[15]  Nikola K. Kasabov,et al.  NeuroSense: Short-term emotion recognition and understanding based on spiking neural network modelling of spatio-temporal EEG patterns , 2021, Neurocomputing.

[16]  Jacek M. Leski,et al.  Validation of Emotiv EPOC+ for extracting ERP correlates of emotional face processing , 2018 .

[17]  Thejus Pathmakumar,et al.  A Tiling-Theoretic Approach to Efficient Area Coverage in a Tetris-Inspired Floor Cleaning Robot , 2018, IEEE Access.

[18]  Chih-Ming Chen,et al.  An efficient fuzzy classifier with feature selection based on fuzzy entropy , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Wenming Zheng,et al.  MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition , 2019, IEEE Access.

[20]  Yunyuan Gao,et al.  Single-trial EEG emotion recognition using Granger Causality/Transfer Entropy analysis , 2020, Journal of Neuroscience Methods.

[21]  Vaishali M. Joshi,et al.  EEG based emotion detection using fourth order spectral moment and deep learning , 2021, Biomed. Signal Process. Control..

[22]  Shangbin Chen,et al.  A EEG-based emotion recognition model with rhythm and time characteristics , 2019, Brain Informatics.

[23]  Xinchun Cui,et al.  EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM , 2021, Appl. Soft Comput..

[24]  Jiang Li,et al.  Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[25]  Turker Tuncer,et al.  A new stable nonlinear textural feature extraction method based EEG signal classification method using substitution Box of the Hamsi hash function: Hamsi pattern , 2021 .

[26]  Huiguang He,et al.  A prototype-based SPD matrix network for domain adaptation EEG emotion recognition , 2021, Pattern Recognit..

[27]  Humaira Nisar,et al.  Comparison of different feature extraction methods for EEG-based emotion recognition , 2020 .

[28]  Ram Bilas Pachori,et al.  Classification of seizure and seizure-free EEG signals using local binary patterns , 2015, Biomed. Signal Process. Control..

[29]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[30]  Terrence J. Sejnowski,et al.  Utilizing Deep Learning Towards Multi-Modal Bio-Sensing and Vision-Based Affective Computing , 2019, IEEE Transactions on Affective Computing.

[31]  Yilmaz Kaya,et al.  1D-local binary pattern based feature extraction for classification of epileptic EEG signals , 2014, Appl. Math. Comput..

[32]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[33]  Xun Chen,et al.  Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network , 2020, Comput. Biol. Medicine.

[34]  Yu Cao,et al.  ReliefF-Based EEG Sensor Selection Methods for Emotion Recognition , 2016, Sensors.

[35]  Weiming Hu,et al.  3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition , 2021, IEEE Journal of Biomedical and Health Informatics.

[36]  Reda A. El-Khoribi,et al.  Emotion Recognition based on EEG using LSTM Recurrent Neural Network , 2017 .

[37]  Enzeng Dong,et al.  A novel hybrid kernel function relevance vector machine for multi-task motor imagery EEG classification , 2020, Biomed. Signal Process. Control..

[38]  Arti Khaparde,et al.  Noise estimation in 2D MRI using DWT coefficients and optimized neural network , 2022, Biomed. Signal Process. Control..

[39]  Andrzej Cichocki,et al.  EmotionMeter: A Multimodal Framework for Recognizing Human Emotions , 2019, IEEE Transactions on Cybernetics.

[40]  Ram Bilas Pachori,et al.  Cross-Subject Emotion Recognition Using Flexible Analytic Wavelet Transform From EEG Signals , 2019, IEEE Sensors Journal.

[41]  Shiru Sharma,et al.  Feature selection using regularized neighbourhood component analysis to enhance the classification performance of motor imagery signals , 2019, Comput. Biol. Medicine.

[42]  Sengul Dogan,et al.  A novel ternary and signum kernelled linear hexadecimal pattern and hybrid feature selection based environmental sound classification method , 2020 .

[43]  Mladen Russo,et al.  Emotion recognition based on EEG feature maps through deep learning network , 2021, Engineering Science and Technology, an International Journal.

[44]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[45]  Hui Wang,et al.  Breast density classification in mammograms: An investigation of encoding techniques in binary-based local patterns , 2020, Comput. Biol. Medicine.

[46]  Francisco Herrera,et al.  kNN-IS: An Iterative Spark-based design of the k-Nearest Neighbors classifier for big data , 2017, Knowl. Based Syst..

[47]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Nicholas Costen,et al.  ECG based biometric identification using one-dimensional local difference pattern , 2021, Biomed. Signal Process. Control..

[49]  Minping Jia,et al.  Intelligent fault diagnosis of rotating machinery using improved multiscale dispersion entropy and mRMR feature selection , 2019, Knowl. Based Syst..

[50]  Ricardo Soto,et al.  Using Black Hole Algorithm to Improve EEG-Based Emotion Recognition , 2018, Comput. Intell. Neurosci..

[51]  Chunyan Miao,et al.  EEG-Based Emotion Recognition Using Regularized Graph Neural Networks , 2019, IEEE Transactions on Affective Computing.

[52]  Wenming Zheng,et al.  Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[53]  Liang Dong,et al.  Emotion Recognition from Multiband EEG Signals Using CapsNet , 2019, Sensors.

[54]  Miad Faezipour,et al.  Sleep Stage Classification Using EEG Signal Analysis: A Comprehensive Survey and New Investigation , 2016, Entropy.

[55]  Fatih Özyurt,et al.  A fused CNN model for WBC detection with MRMR feature selection and extreme learning machine , 2020, Soft Comput..

[56]  Ondrej Krejcar,et al.  An EEG Database and Its Initial Benchmark Emotion Classification Performance , 2020, Comput. Math. Methods Medicine.

[57]  U. Rajendra Acharya,et al.  Automated accurate speech emotion recognition system using twine shuffle pattern and iterative neighborhood component analysis techniques , 2021, Knowl. Based Syst..

[58]  Naeem Ramzan,et al.  DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices , 2018, IEEE Journal of Biomedical and Health Informatics.

[59]  Ayan Seal,et al.  Outlier-robust multi-view clustering for uncertain data , 2021, Knowl. Based Syst..

[60]  Yi Cao,et al.  EEG-Based Emotion Classification Using Spiking Neural Networks , 2020, IEEE Access.

[61]  Soraia M. Alarcão,et al.  Predicting Exact Valence and Arousal Values from EEG , 2021, Sensors.

[62]  Mohamed Elhoseny,et al.  Emotion recognition using empirical mode decomposition and approximation entropy , 2018, Comput. Electr. Eng..

[63]  Talha Burak Alakus,et al.  Database for an emotion recognition system based on EEG signals and various computer games - GAMEEMO , 2020, Biomed. Signal Process. Control..

[64]  Omar Farooq,et al.  A hybrid Local Binary Pattern and wavelets based approach for EEG classification for diagnosing epilepsy , 2020, Expert Syst. Appl..

[65]  Aydin Akan,et al.  Emotion recognition from EEG signals by using multivariate empirical mode decomposition , 2018, Pattern Analysis and Applications.

[66]  Ying Zeng,et al.  EEG Based Emotion Recognition by Combining Functional Connectivity Network and Local Activations , 2019, IEEE Transactions on Biomedical Engineering.

[67]  Dong-Hyun Kang,et al.  Deep Learning Method for Selecting Effective Models and Feature Groups in Emotion Recognition Using an Asian Multimodal Database , 2020 .

[68]  U. Acharya,et al.  PrimePatNet87: Prime pattern and tunable q-factor wavelet transform techniques for automated accurate EEG emotion recognition , 2021, Comput. Biol. Medicine.

[69]  Kongqiao Wang,et al.  EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network , 2020, Knowl. Based Syst..

[70]  Huiguang He,et al.  Multisource Transfer Learning for Cross-Subject EEG Emotion Recognition , 2020, IEEE Transactions on Cybernetics.