A new fractal pattern feature generation function based emotion recognition method using EEG

Abstract Electroencephalogram (EEG) signal analysis is one of the mostly studied research areas in biomedical signal processing, and machine learning. Emotion recognition through machine intelligence plays critical role in understanding the brain activities as well as in developing decision-making systems. In this research, an automated EEG based emotion recognition method with a novel fractal pattern feature extraction approach is presented. The presented fractal pattern is inspired by Firat University Logo and named fractal Firat pattern (FFP). By using FFP and Tunable Q-factor Wavelet Transform (TQWT) signal decomposition technique, a multilevel feature generator is presented. In the feature selection phase, an improved iterative selector is utilized. The shallow classifiers have been considered to denote the success of the presented TQWT and FFP based feature generation. This model has been tested on emotional EEG signals with 14 channels using linear discriminant (LDA), k-nearest neighborhood (k-NN), support vector machine (SVM). The proposed framework achieved 99.82% with SVM classifier.

[1]  Yasar Dasdemir,et al.  Analysis of functional brain connections for positive–negative emotions using phase locking value , 2017, Cognitive Neurodynamics.

[2]  Won-Hyung Lee,et al.  Dynamic Game Difficulty Control by Using EEG-based Emotion Recognition , 2014 .

[3]  Yanli Yin,et al.  Fault detection and diagnosis of a wheelset-bearing system using a multi-Q-factor and multi-level tunable Q-factor wavelet transform , 2019 .

[4]  Nersisson Ruban,et al.  Cubic SVM Classifier Based Feature Extraction and Emotion Detection from Speech Signals , 2018, 2018 International Conference on Sensor Networks and Signal Processing (SNSP).

[5]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Ruoyu Du,et al.  Optimal Feature Selection and Deep Learning Ensembles Method for Emotion Recognition From Human Brain EEG Sensors , 2017, IEEE Access.

[7]  Valery A. Petrushin,et al.  EMOTION IN SPEECH: RECOGNITION AND APPLICATION TO CALL CENTERS , 1999 .

[8]  Suhua Zhang,et al.  An approach to EEG-based emotion recognition using combined feature extraction method , 2016, Neuroscience Letters.

[9]  Xue Wang,et al.  Wearable biosensor network enabled multimodal daily-life emotion recognition employing reputation-driven imbalanced fuzzy classification , 2017 .

[10]  D. Jude Hemanth,et al.  Brain signal based human emotion analysis by circular back propagation and Deep Kohonen Neural Networks , 2018, Comput. Electr. Eng..

[11]  Dong-dong Li,et al.  EEG-based emotion recognition using simple recurrent units network and ensemble learning , 2020, Biomed. Signal Process. Control..

[12]  Mohammed Al-Sarem,et al.  Feature selection using an improved Chi-square for Arabic text classification , 2020, J. King Saud Univ. Comput. Inf. Sci..

[13]  G. Knyazev,et al.  Gender differences in implicit and explicit processing of emotional facial expressions as revealed by event-related theta synchronization. , 2010, Emotion.

[14]  Cherukuri Aswani Kumar,et al.  Intrusion detection model using fusion of chi-square feature selection and multi class SVM , 2017, J. King Saud Univ. Comput. Inf. Sci..

[15]  Ivan W. Selesnick,et al.  Sparse signal representations using the tunable Q-factor wavelet transform , 2011, Optical Engineering + Applications.

[16]  Sengul Dogan,et al.  A novel statistical decimal pattern-based surface electromyogram signal classification method using tunable q-factor wavelet transform , 2020, Soft Computing.

[17]  Yongqiang Cheng,et al.  Interpretable Emotion Recognition Using EEG Signals , 2019, IEEE Access.

[18]  M. Cabanac.  Physiological Role of Pleasure , 1971, Science.

[19]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[20]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Aya Hassouneh,et al.  Development of a Real-Time Emotion Recognition System Using Facial Expressions and EEG based on machine learning and deep neural network methods , 2020, Informatics in Medicine Unlocked.

[22]  Yong Zhang,et al.  Dendritic spine detection using curvilinear structure detector and LDA classifier , 2007, NeuroImage.

[23]  Tian Chen,et al.  EEG emotion recognition model based on the LIBSVM classifier , 2020 .

[24]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[25]  Xun Chen,et al.  Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network , 2020, Comput. Biol. Medicine.

[26]  Xue Wang,et al.  Sparse EEG compressive sensing for web-enabled person identification , 2015 .

[27]  Huiguang He,et al.  Multisource Transfer Learning for Cross-Subject EEG Emotion Recognition , 2020, IEEE Transactions on Cybernetics.

[28]  Bao-Liang Lu,et al.  A multimodal approach to estimating vigilance using EEG and forehead EOG , 2016, Journal of neural engineering.

[29]  Sengul Dogan,et al.  Automated arrhythmia detection using novel hexadecimal local pattern and multilevel wavelet transform with ECG signals , 2019, Knowl. Based Syst..

[30]  Li Wang,et al.  Analysis and classification of hybrid BCI based on motor imagery and speech imagery , 2019 .

[31]  Naeem Ramzan,et al.  DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices , 2018, IEEE Journal of Biomedical and Health Informatics.

[32]  Talha Burak Alakus,et al.  Database for an emotion recognition system based on EEG signals and various computer games - GAMEEMO , 2020, Biomed. Signal Process. Control..

[33]  Tong Zhang,et al.  Spatial–Temporal Recurrent Neural Network for Emotion Recognition , 2017, IEEE Transactions on Cybernetics.

[34]  Mingjiang Wang,et al.  Dynamic entropy-based pattern learning to identify emotions from EEG signals across individuals , 2020 .

[35]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[36]  Hyunjin Yoon,et al.  Emotion recognition of serious game players using a simple brain computer interface , 2013, 2013 International Conference on ICT Convergence (ICTC).

[37]  Jianhua Zhang,et al.  Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review , 2020, Inf. Fusion.

[38]  Christian Mühl,et al.  Valence, arousal and dominance in the EEG during game play , 2013, Int. J. Auton. Adapt. Commun. Syst..

[39]  Vinod Chandran,et al.  Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors , 2018, Expert Syst. Appl..

[40]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[41]  Yong-Jin Liu,et al.  Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals , 2018, IEEE Transactions on Affective Computing.

[42]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[43]  P. Ekman.  An argument for basic emotions , 1992 .

[44]  K. R. Seeja,et al.  Subject independent emotion recognition from EEG using VMD and deep learning , 2019, J. King Saud Univ. Comput. Inf. Sci..

[45]  Nacho L'opez,et al.  Network reliability in hamiltonian graphs , 2021, Discret. Optim..

[46]  Pradip Sircar,et al.  Automated emotion recognition based on higher order statistics and deep learning algorithm , 2020, Biomed. Signal Process. Control..

[47]  Bao-Liang Lu,et al.  Identifying Stable Patterns over Time for Emotion Recognition from EEG , 2016, IEEE Transactions on Affective Computing.

[48]  Fotis Liarokapis,et al.  EEG-based BCI and video games: a progress report , 2018, Virtual Reality.

[49]  U. Rajendra Acharya,et al.  Automated invasive ductal carcinoma detection based using deep transfer learning with whole-slide images , 2020, Pattern Recognit. Lett..

[50]  Ali Motie Nasrabadi,et al.  Emotion recognition using EEG phase space dynamics and Poincare intersections , 2020, Biomed. Signal Process. Control..

[51]  V. Rao Vemuri,et al.  Use of K-Nearest Neighbor classifier for intrusion detection , 2002, Comput. Secur..