EEG-Analysis for the Detection of True Emotion or Pretension

Several lobes in the human brain are involved differently in the arousal, processing and manifestation of emotion in facial expression, vocal intonation and gestural patterns. Sometimes people suppress their bodily manifestations to pretend their emotions. Detection of emotion and pretension is an open problem in emotion research. The chapter presents an analysis of EEG signals to detect true emotion/pretension: first by extracting the neural connectivity among selected brain lobes during arousal and manifestation of a true emotion, and then by testing whether the connectivity among the lobes are maintained while encountering an emotional context. In case the connectivity is manifested, the arousal of emotion is regarded as true emotion, otherwise it is considered as a pretension. Experimental results confirm that for positive emotions, the decoding accuracy of true (false) emotions is as high as 88% (72%), while for negative emotions, the classification accuracy falls off by a 12% margin for true emotions and 8% margin for false emotions. The proposed method has wide-spread applications to detect criminals, frauds and anti-socials.

[1]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[2]  J. Mazziotta,et al.  Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Hanna Damasio,et al.  Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex , 2001, Nature Neuroscience.

[4]  Sazali Yaacob,et al.  EEG feature extraction for classifying emotions using FCM and FKM , 2008 .

[5]  John J. B. Allen,et al.  Voluntary facial expression and hemispheric asymmetry over the frontal cortex. , 2001, Psychophysiology.

[6]  Randall S. Sexton,et al.  Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing , 1999, Eur. J. Oper. Res..

[7]  U. Dimberg,et al.  Rapid facial reactions to emotional facial expressions. , 1998, Scandinavian journal of psychology.

[8]  Amit Konar,et al.  Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  P. S. Sastry,et al.  Analysis of the back-propagation algorithm with momentum , 1994, IEEE Trans. Neural Networks.

[10]  Hao Yu,et al.  Levenberg—Marquardt Training , 2011 .

[11]  Yongjie Zhao,et al.  Dynamic Performance Evaluation of a Parallel Manipulator with Non Axial Symmetrical Characteristics by Computing the Respective Actuating Joint Capability , 2012, Int. J. Intell. Mechatronics Robotics.

[12]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[13]  Sergej Fatikow,et al.  Open Loop Force Control of Piezo-Actuated Stick-Slip Drives , 2011, Int. J. Intell. Mechatronics Robotics.

[14]  Kai Keng Ang,et al.  EEG-based Emotion Recognition Using Self-Organizing Map for Boundary Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  Jeonghun Ku,et al.  The neural mechanism of imagining facial affective expression , 2007, Brain Research.

[16]  B. Onaral,et al.  Wavelet analysis for EEG feature extraction in deception detection , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Maja Pantic,et al.  Hierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises , 2013, Image Vis. Comput..

[18]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[19]  B. Rockstroh,et al.  Statistical control of artifacts in dense array EEG/MEG studies. , 2000, Psychophysiology.

[20]  R. Töpper,et al.  Motor cortex hand area and speech: implications for the development of language , 2003, Neuropsychologia.

[21]  R. Morecraft,et al.  The Motor Cortex and Facial Expression:: New Insights From Neuroscience , 2004, The neurologist.

[22]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition from Brain Signals Using Hybrid Adaptive Filtering and Higher Order Crossings Analysis , 2010, IEEE Transactions on Affective Computing.

[23]  J. Russell,et al.  Facial and vocal expressions of emotion. , 2003, Annual review of psychology.

[24]  B. Hjorth.  EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[25]  F. S. Wong.  FastProp: a selective training algorithm for fast error propagation , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[26]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[27]  Hugo D Critchley,et al.  Imitating expressions: emotion-specific neural substrates in facial mimicry. , 2006, Social cognitive and affective neuroscience.

[28]  J. Desmond,et al.  Hemispheric asymmetry for emotional stimuli detected with fMRI , 1998, Neuroreport.

[29]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[30]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[31]  Amit Konar,et al.  General and Interval Type-2 Fuzzy Face-Space Approach to Emotion Recognition , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Shrikanth S. Narayanan,et al.  Toward detecting emotions in spoken dialogs , 2005, IEEE Transactions on Speech and Audio Processing.

[33]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Lionel Buchaillot,et al.  Piezoresistive Ring-Shaped AFM Sensors with Pico-Newton Force Resolution , 2013, Int. J. Intell. Mechatronics Robotics.

[35]  L. Rothkrantz,et al.  Toward an affect-sensitive multimodal human-computer interaction , 2003, Proc. IEEE.