The dynamic emotion recognition system based on functional connectivity of brain regions

Emotion perception similar to thinking, learning and remembering is consequent of complicated brain processes which are related to specific biological metabolism. Different human's emotional states are recognizable by measuring and interpreting of human physiological signals. Bio-sensors possess a number of advantages against other emotion recognition methods as they are relatively more consistent across cultures and nations. Emotions have a serious effect on driving. Human beings in negative and sometimes positive emotional states can be distracted which will increase the risk of driving. This paper presents an EEG-based emotion recognition system. Mutual information and magnitude squared coherence are applied to investigate the interconnectivity between 8 scalp regions. A study was performed to collect 8 channels of EEG data from 26 healthy right-handed subjects in experiencing 4 emotional states while exposed to audio-visual emotional stimuli. After feature extraction, 5-fold cross-validation was then performed using the KNN and SVM classifier. The results showed existence of different kind of functional brain connectivity in different emotional states.

[1]  J. Russell.  A circumplex model of affect. , 1980 .

[2]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  K. Scherer,et al.  EMOTIONAL EFFECTS OF MUSIC: PRODUCTION RULES , 2001 .

[4]  Tieniu Tan,et al.  Affective Computing: A Review , 2005, ACII.

[5]  I. Peretz,et al.  Evidence of lateralized anteromedial temporal structures involvement in musical emotion processing , 2008, Neuropsychologia.

[6]  L. C. De Silva,et al.  Bimodal emotion recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[8]  Yingzi Lin,et al.  Study on Driver Emotion in Driver-Vehicle-Environment Systems Using Multiple Networked Driving Simulators , 2007 .

[9]  Jonghwa Kim,et al.  Bimodal Emotion Recognition using Speech and Physiological Changes , 2007 .

[10]  Herbert Gish.  The magnitude squared coherence estimate: A geometric view , 1984, ICASSP.

[11]  G. Erdmann,et al.  Interaction between physiological and cognitive determinants of emotions: Experimental studies on Schachter's theory of emotions , 1978, Biological Psychology.

[12]  H. Sackeim,et al.  Emotions are expressed more intensely on the left side of the face. , 1978, Science.

[13]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[14]  R. Volner.  Based analysis of interaction between human subject and artificial system - impacts of driver attention failures on transport reliability and safety , 2005, Proceedings 39th Annual 2005 International Carnahan Conference on Security Technology.

[15]  William J. German,et al.  The Hypothalamus and Central Levels of Autonomic Function , 1940, Nature.

[16]  Isabelle Peretz,et al.  Toward a Biological Account of Music Experience , 2000, Brain and Cognition.

[17]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[18]  L. Aftanas,et al.  Human anterior and frontal midline theta and lower alpha reflect emotionally positive state and internalized attention: high-resolution EEG investigation of meditation , 2001, Neuroscience Letters.

[19]  M. Balconi,et al.  Consciousness and arousal effects on emotional face processing as revealed by brain oscillations. A gamma band analysis. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[21]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[22]  I. Peretz,et al.  Happy, sad, scary and peaceful musical excerpts for research on emotions , 2008 .

[23]  Kai Keng Ang,et al.  Affective computation on EEG correlates of emotion from musical and vocal stimuli , 2009, 2009 International Joint Conference on Neural Networks.

[24]  H. Petsche,et al.  Interdependencies in the spontaneous EEG while listening to music. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  R. F. Farquharson.  The Hypothalamus and Central levels of Autonomic Function. Proceedings of the Association for Research in Nervous and Mental Disease, December 20 and 21, 1939, New York. Research Publications, Association for Research in Nervous and Mental Disease, Volume XX , 1942 .

[26]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[27]  Abdul Wahab,et al.  Emotional State Discrimination by One EEG Channel , 2008, CAINE.

[28]  T. Dalgleish.  Basic Emotions , 2004 .

[29]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.