Emotion recognition from multichannel EEG signals using K-nearest neighbor classification

BACKGROUND: Many studies have been done on the emotion recognition based on multi-channel electroencephalogram (EEG) signals. OBJECTIVE: This paper explores the influence of the emotion recognition accuracy of EEG signals in different frequency bands and different number of channels. METHODS: We classified the emotional states in the valence and arousal dimensions using different combinations of EEG channels. Firstly, DEAP default preprocessed data were normalized. Next, EEG signals were divided into four frequency bands using discrete wavelet transform, and entropy and energy were calculated as features of K-nearest neighbor Classifier. RESULTS: The classification accuracies of the 10, 14, 18 and 32 EEG channels based on the Gamma frequency band were 89.54%, 92.28%, 93.72% and 95.70% in the valence dimension and 89.81%, 92.24%, 93.69% and 95.69% in the arousal dimension. As the number of channels increases, the classification accuracy of emotional states also increases, the classification accuracy of the gamma frequency band is greater than that of the beta frequency band followed by the alpha and theta frequency bands. CONCLUSIONS: This paper provided better frequency bands and channels reference for emotion recognition based on EEG.

[1]  P. Ekman,et al.  Emotion and autonomic nervous system activity in the Minangkabau of west Sumatra. , 1992, Journal of personality and social psychology.

[2]  Masayuki Numao,et al.  Application of deep belief networks in eeg-based dynamic music-emotion recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[3]  Kyandoghere Kyamakya,et al.  EEG-based emotion recognition approach for e-healthcare applications , 2016, 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN).

[4]  Yong Peng,et al.  EEG-based emotion recognition using discriminative graph regularized extreme learning machine , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[5]  Xiang Li,et al.  Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[6]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[7]  Bo Cheng,et al.  Emotion Recognition from Surface EMG Signal Using Wavelet Transform and Neural Network , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[8]  Andreas Stolcke,et al.  Prosody-based automatic detection of annoyance and frustration in human-computer dialog , 2002, INTERSPEECH.

[9]  Jing Cai,et al.  The Research on Emotion Recognition from ECG Signal , 2009, 2009 International Conference on Information Technology and Computer Science.

[10]  Yu Cao,et al.  ReliefF-Based EEG Sensor Selection Methods for Emotion Recognition , 2016, Sensors.

[11]  Kyandoghere Kyamakya,et al.  EEG-based emotion recognition approach for e-healthcare applications , 2016, ICUFN.

[12]  Stephan Hamann,et al.  Mapping discrete and dimensional emotions onto the brain: controversies and consensus , 2012, Trends in Cognitive Sciences.

[13]  S. Koelsch.  Brain correlates of music-evoked emotions , 2014, Nature Reviews Neuroscience.

[14]  Bao-Liang Lu,et al.  Emotion classification based on gamma-band EEG , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Sazali Yaacob,et al.  EEG feature extraction for classifying emotions using FCM and FKM , 2008 .

[16]  Olga Sourina,et al.  Real-Time EEG-Based Human Emotion Recognition and Visualization , 2010, 2010 International Conference on Cyberworlds.

[17]  Aydin Akan,et al.  Emotion recognition from EEG signals by using multivariate empirical mode decomposition , 2018, Pattern Analysis and Applications.

[18]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[19]  John Atkinson,et al.  Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers , 2016, Expert Syst. Appl..

[20]  Konstantinos N. Plataniotis,et al.  Affective states classification using EEG and semi-supervised deep learning approaches , 2016, 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP).

[21]  Wei Liu,et al.  Emotion Recognition Using Multimodal Deep Learning , 2016, ICONIP.

[22]  S. Yoo,et al.  Using Neural Network to Recognize Human Emotions from Heart Rate Variability and Skin Resistance , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[23]  Peerapon Vateekul,et al.  An evaluation of feature extraction in EEG-based emotion prediction with support vector machines , 2014, 2014 11th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[24]  Uma Shanker Tiwary,et al.  Affect representation and recognition in 3D continuous valence–arousal–dominance space , 2016, Multimedia Tools and Applications.

[25]  Javad Frounchi,et al.  Wavelet-based emotion recognition system using EEG signal , 2017, Neural Computing and Applications.

[26]  C. Witvliet,et al.  Play it again Sam: Repeated exposure to emotionally evocative music polarises liking and smiling responses, and influences other affective reports, facial EMG, and heart rate , 2007 .

[27]  Nitin Kumar,et al.  Bispectral Analysis of EEG for Emotion Recognition , 2015, IHCI.