Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT)

Human emotion recognition plays a vital role in psychology, psycho-physiology and human machine interface (HMI) design. Electroencephalogram (EEG) reflects the internal emotional state changes of the subject compared to other conventional methods (face recognition, gestures, speech, etc). In this work, EEG signals are collected using 62 channels from 20 subjects in the age group of 21~39 years for determining discrete emotions. Audio-visual stimuli (video clips) is used for inducing five different emotions (happy, surprise, fear, disgust, neutral). EEG signals are preprocessed through Butterworth 4th order filter with a cut off frequency of 0.5 Hz-60 Hz and smoothened using Surface Laplacian filter. EEG signals are framed into a short time duration of 5s and two statistical features (spectral centroid and spectral entropy) in four frequency bands namely alpha (8 Hz-16 Hz), beta (16 Hz-32 Hz), gamma (32 Hz-60 Hz) and alpha to gamma (8 Hz-60 Hz) are extracted using Fast Fourier Transform (FFT). These features are mapped into the corresponding emotions using two simple classifiers such as K Nearest Neighbor(KNN) and Probabilistic Neural Network (PNN). In this work, KNN outperforms PNN by offering the maximum mean classification accuracy of 91.33 % on beta band. This experimental results indicates the short time duration of EEG signals is highly essential for detecting the emotional state changes of the subjects.

[1]  Kazuhiko Takahashi.  Remarks on Emotion Recognition from Bio-Potential Signals , 2004 .

[2]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  B. Onaral,et al.  Wavelet analysis for EEG feature extraction in deception detection , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Shweta Kumari.  CLASSIFICATION AND CLUSTERING OF BRAIN SEIZURE ACTIVITY USING WAVELET TRANS-FORM AND RADIAL BASIS NEURAL NETWORK , 2012 .

[5]  Abbas Erfanian,et al.  An online EEG-based brain-computer interface for controlling hand grasp using an adaptive probabilistic neural network. , 2010, Medical engineering & physics.

[6]  Jia Huaping.  Classification for EEG Signals of Different Mental Tasks Based on PNN neural network , 2012 .

[7]  Sazali Yaacob,et al.  An investigation on visual and audiovisual stimulus based emotion recognition using EEG , 2009, Int. J. Medical Eng. Informatics.

[8]  Thierry Pun,et al.  Valence-arousal evaluation using physiological signals in an emotion recall paradigm , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[9]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[10]  Pau-Choo Chung,et al.  Representative Segment-Based Emotion Analysis and Classification with Automatic Respiration Signal Segmentation , 2012, IEEE Transactions on Affective Computing.

[11]  Peggy S. Gott,et al.  Voluntary control of two lateralized conscious states: Validation by electrical and behavioral studies , 1984, Neuropsychologia.

[12]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[13]  Charles W. Anderson,et al.  Classification of EEG Signals from Four Subjects During Five Mental Tasks , 2007 .

[14]  Bao-Liang Lu,et al.  EEG-Based Emotion Recognition Using Frequency Domain Features and Support Vector Machines , 2011, ICONIP.

[15]  C. Parameswariah,et al.  Frequency Characteristics of Wavelets , 2002, IEEE Power Engineering Review.

[16]  G..  A Theory for Multiresolution Signal Decomposition : The Wavelet Representation , 2004 .

[17]  M. Murugappan,et al.  Time-Frequency Analysis of EEG Signals for Human Emotion Detection , 2008 .

[18]  Saeed Badshah,et al.  Vibration Analysis of an Ocean Current Turbine Blade , 2012 .

[19]  S. Furui,et al.  Automatic recognition and understanding of spoken language - a first step toward natural human-machine communication , 2000, Proceedings of the IEEE.

[20]  S. Nasehi,et al.  An Optimal EEG-based Emotion Recognition Algorithm Using Gabor Features , 2012 .

[21]  Ya-Ju Fan,et al.  On the Time Series $K$-Nearest Neighbor Classification of Abnormal Brain Activity , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Jia Hua-ping.  Classification for EEG signals of different mental tasks , 2010 .

[23]  K. Balasamy,et al.  Lyapunov features based EEG signal classification by multi-class SVM , 2011, 2011 World Congress on Information and Communication Technologies.