Intelligent human emotion recognition based on elephant herding optimization tuned support vector regression

Abstract The ability to recognize emotional states of people surrounding us is an important portion of natural communication as emotions are fundamental factors in human decision handling, interaction, and cognitive procedure. The primary intention of this paper is to present an approach that uses electroencephalography (EEG) signals to recognize human emotions. This work targets emotional recognition in terms of three emotional scales; valence, arousal and dominance. EEG raw data were pre-processed to remove artifacts, discrete wavelet transform (DWT) was applied for features extraction. Moreover, support vector regression (SVR) is combined with Elephant herding optimization (EHO) to predict values of the three emotional scales as continuous variables. Multiple experiments are applied to evaluate prediction performance. EHO was applied in two stages of optimization. Firstly, to fine-tune regression parameters of the SVR. Secondly, to select the most relevant features extracted from all 40 EEG channels and eliminate ineffective and redundant features. To verify the proposed approach, results proved EHO-SVR ability to gain relatively enhanced performance measured by regression accuracy of 98.64%. Therefore, SVR is introduced in this paper as a better technique for predicting emotions as quantifiable continuous variables rather than classifying emotions into discrete emotional values.

[1]  Aboul Ella Hassanien,et al.  Feature extraction of epilepsy EEG using discrete wavelet transform , 2016, 2016 12th International Computer Engineering Conference (ICENCO).

[2]  Jeffrey B. Henriques,et al.  Left frontal hypoactivation in depression. , 1991, Journal of abnormal psychology.

[3]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[4]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[5]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[6]  J. Russell.  A circumplex model of affect. , 1980 .

[7]  Minoru Sasaki,et al.  EEG data classification with several mental tasks , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[8]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[9]  Mohammad Soleymani,et al.  Queries and tags in affect-based multimedia retrieval , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[10]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[11]  Seong Youb Chung,et al.  Affective classification using Bayesian classifier and supervised learning , 2012, 2012 12th International Conference on Control, Automation and Systems.

[12]  Tao Zhang,et al.  Classification of epilepsy EEG signals using DWT-based envelope analysis and neural network ensemble , 2017, Biomed. Signal Process. Control..

[13]  Elif Derya íbeyli.  Wavelet/mixture of experts network structure for EEG signals classification , 2008 .

[14]  Johan Hagelbäck,et al.  Evaluating Classifiers for Emotion Recognition Using EEG , 2013, HCI.

[15]  S. Yaacob,et al.  Lifting scheme for human emotion recognition using EEG , 2008, 2008 International Symposium on Information Technology.

[16]  Aboul Ella Hassanien,et al.  A Hybrid EEG Signals Classification Approach Based on Grey Wolf Optimizer Enhanced SVMs for Epileptic Detection , 2017, AISI.

[17]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[18]  Seong Youb Chung,et al.  EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithm , 2013, Comput. Biol. Medicine.

[19]  Yuan-Pin Lin,et al.  EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Dinesh Kant Kumar,et al.  Evaluation of feature extraction techniques in emotional state recognition , 2012, 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI).

[21]  Banghua Yang,et al.  EEG Classification Based on Artificial Neural Network in Brain Computer Interface , 2010 .

[22]  R. Davidson,et al.  Anterior electrophysiological asymmetries, emotion, and depression: conceptual and methodological conundrums. , 1998, Psychophysiology.

[23]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[24]  Mark S. Leeson,et al.  Artificial Intelligence in Medicine Channel Selection and Classification of Electroencephalogram Signals: an Artificial Neural Network and Genetic Algorithm-based Approach , 2022 .

[25]  Esmat Rashedi,et al.  Automatic channel selection in EEG signals for classification of left or right hand movement in Brain Computer Interfaces using improved binary gravitation search algorithm , 2017, Biomed. Signal Process. Control..

[26]  James C. Christensen,et al.  An assessment of non-stationarity in physiological cognitive state assessment using artificial neural networks , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Li Li,et al.  Emotion recognition based on the sample entropy of EEG. , 2014, Bio-medical materials and engineering.

[28]  Qing Wu,et al.  Classify the number of EEG current sources using support vector machines , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[29]  Qing Zhang,et al.  Analysis of positive and negative emotions in natural scene using brain activity and GIST , 2009, Neurocomputing.

[30]  Aboul Ella Hassanien,et al.  Swarm Intelligence: Principles, Advances, and Applications , 2015 .

[31]  M. Sreeshakthy,et al.  Classification of Human Emotion from Deap EEG Signal Using Hybrid Improved Neural Networks with Cuckoo Search , 2016 .

[32]  Changchun Liu,et al.  An empirical study of machine learning techniques for affect recognition in human–robot interaction , 2006, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  S. Deb,et al.  Elephant Herding Optimization , 2015, 2015 3rd International Symposium on Computational and Business Intelligence (ISCBI).

[34]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[35]  Aboul Ella Hassanien,et al.  EEG signals classification for epileptic detection: a review , 2017, ICC.

[36]  Kamlesh Mistry,et al.  Intelligent facial emotion recognition using moth-firefly optimization , 2016, Knowl. Based Syst..

[37]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[38]  Olga Sourina,et al.  Real-Time Subject-Dependent EEG-Based Emotion Recognition Algorithm , 2014, Trans. Comput. Sci..

[39]  Valeriy V. Gavrishchaka,et al.  Support Vector Machine as an Efficient Framework for Stock Market Volatility Forecasting , 2006, Comput. Manag. Sci..

[40]  D. Sharmila,et al.  AIEFS and HEC based emotion estimation using physiological measurements for the children with autism spectrum disorder. , 2016 .