Brain signal based human emotion analysis by circular back propagation and Deep Kohonen Neural Networks

Abstract Human emotion analysis is one of the challenging tasks in today's scenario. The success rate of human emotion recognition has high implication in practical applications such as Human Machine Interaction, anomaly detection, surveillance, etc. Artificial Neural Networks (ANN) is one of the highly favored computational intelligence techniques for human emotion recognition. However, the performance of traditional ANN is not satisfactory in case of applications such as human emotion analysis. This leads to the necessity of modified ANN with better performance than the conventional systems. In this paper, we propose Circular Back Propagation Neural Network (CBPN) and Deep Kohonen Neural Network (DKNN) to overcome drawbacks of the traditional neural networks regarding computational complexity and accuracy. Performance of the proposals is explored in classifying different emotions of humans using Electroencephalography (EEG) signals. It has been validated that the proposals have better performance than the related methods.

[1]  Hyo Jong Lee,et al.  A novel feature extraction method based on late positive potential for emotion recognition in human brain signal patterns , 2016, Comput. Electr. Eng..

[2]  Manasi S. Patwardhan,et al.  Survey on real-time facial expression recognition techniques , 2016, IET Biom..

[3]  Siddharth Swarup Rautaray,et al.  A Survey on Face Detection and Recognition Techniques in Different Application Domain , 2014 .

[4]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[5]  Albert Ali Salah,et al.  Video-based emotion recognition in the wild using deep transfer learning and score fusion , 2017, Image Vis. Comput..

[6]  Syed Muhammad Anwar,et al.  Human emotion recognition and analysis in response to audio music using brain signals , 2016, Comput. Hum. Behav..

[7]  Diego H. Milone,et al.  Spoken emotion recognition using hierarchical classifiers , 2011, Comput. Speech Lang..

[8]  Lisa Feldman Barrett,et al.  States of mind: Emotions, body feelings, and thoughts share distributed neural networks , 2012, NeuroImage.

[9]  Wan Khairunizam,et al.  Implementation of wavelet packet transform and non linear analysis for emotion classification in stroke patient using brain signals , 2017, Biomed. Signal Process. Control..

[10]  Alberto L. Morán,et al.  Assessing the user experience of older adults using a neural network trained to recognize emotions from brain signals , 2016, J. Biomed. Informatics.

[11]  Zankhana H. Shah,et al.  Facial Expression Recognition: A Survey , 2014 .

[12]  Petia D. Koprinkova-Hristova,et al.  Learning to decode human emotions with Echo State Networks , 2016, Neural Networks.

[13]  Fakhri Karray,et al.  Survey on speech emotion recognition: Features, classification schemes, and databases , 2011, Pattern Recognit..

[14]  Stefan Wermter,et al.  Emotion-modulated attention improves expression recognition: A deep learning model , 2017, Neurocomputing.

[15]  Edilson de Aguiar,et al.  Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order , 2017, Pattern Recognit..

[16]  Felipe Trujillo-Romero,et al.  Multimodal emotion recognition with evolutionary computation for human-robot interaction , 2016, Expert Syst. Appl..

[17]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[18]  K. YogeshC.,et al.  Hybrid BBO_PSO and higher order spectral features for emotion and stress recognition from natural speech , 2017, Appl. Soft Comput..

[19]  Sazali Yaacob,et al.  Improved Emotion Recognition Using Gaussian Mixture Model and Extreme Learning Machine in Speech and Glottal Signals , 2015 .

[20]  Petia D. Koprinkova-Hristova,et al.  Reservoir computing for emotion valence discrimination from EEG signals , 2017, Neurocomputing.

[21]  Shashidhar G. Koolagudi,et al.  Recognition of emotions from video using neural network models , 2011, Expert Syst. Appl..

[22]  Jyoti Kumari,et al.  Facial Expression Recognition: A Survey , 2015 .

[23]  Lucy Barnard-Brak,et al.  Facial emotion recognition among typically developing young children: A psychometric validation of a subset of NimStim stimuli , 2017, Psychiatry Research.

[24]  K. YogeshC.,et al.  A new hybrid PSO assisted biogeography-based optimization for emotion and stress recognition from speech signal , 2017, Expert Syst. Appl..

[25]  Theodoros Iliou,et al.  Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011 , 2012, Artificial Intelligence Review.