Research on EEG Channel Selection Method for Emotion Recognition

In this paper, based on the DEAP dataset, we studied the effects of different EEG channel selection methods on the accuracy of emotion recognition for different frequency bands. First, the discrete wavelet transform method is used to divide the EEG signals into four bands of gamma, beta, alpha and theta, and extract the entropy and energy of each band as classification features. Then, the following three channel selection methods are compared to select the best EEG channel combination for the four emotions classification susing, the channel selection method based on experience, the indirect channel selection method based on the mRMR feature selection algorithm, and the direct channel selection method based on the mRMR feature selection algorithm. Finally, the extreme learning machine with kernel is used to verify the effectiveness of the channel selection method. The results show that based on the mRMR feature selection algorithm, the channel selection method taking each channel as a whole is more powerful in balancing the number of channels and classification accuracy. In the beta band, the number of channels is reduced from 32 to 22, which is only 1.37% (from 80.83% to 79.37%) lower than the best classification accuracy, and the emotion recognition performance remains at a high level. Compared with the results of others, this paper can use less channels to achieve similar or higher emotional recognition performance than others, which further proves the effectiveness of the method. In addition, we also found that high frequencies (gamma and beta bands) are better for emotional recognition. This study provides a reference for channel and band selection in EEG-based emotion recognition.

[1]  G. Dawson,et al.  Frontal lobe activity and affective behavior of infants of mothers with depressive symptoms. , 1992, Child development.

[2]  C. Witvliet,et al.  Play it again Sam: Repeated exposure to emotionally evocative music polarises liking and smiling responses, and influences other affective reports, facial EMG, and heart rate , 2007 .

[3]  Wenjun Zeng,et al.  Deeply-Fused Nets , 2016, ArXiv.

[4]  Bin Hu,et al.  Exploring EEG Features in Cross-Subject Emotion Recognition , 2018, Front. Neurosci..

[5]  Bao-Liang Lu,et al.  EEG-Based Emotion Recognition Using Frequency Domain Features and Support Vector Machines , 2011, ICONIP.

[6]  Yu Cao,et al.  ReliefF-Based EEG Sensor Selection Methods for Emotion Recognition , 2016, Sensors.

[7]  Yue Wang,et al.  Subject-independent emotion recognition based on physiological signals: a three-stage decision method , 2017, BMC Medical Informatics and Decision Making.

[8]  Chi Zhang,et al.  Investigating Patterns for Self-Induced Emotion Recognition from EEG Signals , 2018, Sensors.

[9]  Javad Frounchi,et al.  Wavelet-based emotion recognition system using EEG signal , 2017, Neural Computing and Applications.

[10]  Aydin Akan,et al.  Emotion recognition from EEG signals by using multivariate empirical mode decomposition , 2018, Pattern Analysis and Applications.

[11]  Jing Cai,et al.  The Research on Emotion Recognition from ECG Signal , 2009, 2009 International Conference on Information Technology and Computer Science.

[12]  Egon L. van den Broek,et al.  Computing Emotion Awareness Through Facial Electromyography , 2006, ECCV Workshop on HCI.

[13]  Loïc Kessous,et al.  Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis , 2010, Journal on Multimodal User Interfaces.

[14]  Masayuki Numao,et al.  Application of deep belief networks in eeg-based dynamic music-emotion recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[15]  John Atkinson,et al.  Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers , 2016, Expert Syst. Appl..

[16]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[17]  Andreas Stolcke,et al.  Prosody-based automatic detection of annoyance and frustration in human-computer dialog , 2002, INTERSPEECH.

[18]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[19]  R. Krauss,et al.  Facial and autonomic manifestations of the dimensional structure of emotion , 1984 .

[20]  Mohammad I. Daoud,et al.  EEG-Based Emotion Recognition Using Quadratic Time-Frequency Distribution , 2018, Sensors.

[21]  Yue Wang,et al.  A three-stage decision framework for multi-subject emotion recognition using physiological signals , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[22]  Vinod Chandran,et al.  Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors , 2018, Expert Syst. Appl..

[23]  J. E. Rose,et al.  Autonomic Nervous System Activity Distinguishes Among Emotions , 2009 .

[24]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  S. Yoo,et al.  Using Neural Network to Recognize Human Emotions from Heart Rate Variability and Skin Resistance , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[26]  Yong Peng,et al.  EEG-based emotion recognition using discriminative graph regularized extreme learning machine , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[27]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[28]  Peerapon Vateekul,et al.  An evaluation of feature extraction in EEG-based emotion prediction with support vector machines , 2014, 2014 11th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[29]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[30]  Jane Labadin,et al.  Feature selection based on mutual information , 2015, 2015 9th International Conference on IT in Asia (CITA).