A Fractal-based Algorithm of Emotion Recognition from EEG using Arousal-Valence Model

Emotion recognition from EEG could be used in many applications as it allows us to know the “inner” emotion regardless of the human facial expression, behaviour, or verbal communication. In this paper, we proposed and described a novel fractal dimension (FD) based emotion recognition algorithm using an Arousal-Valence emotion model. FD values calculated from the EEG signal recorded from the corresponding brain lobes are mapped to the 2D emotion model. The proposed algorithm allows us to recognize emotions that could be defined by arousal and valence levels. Only 3 electrodes are needed for the emotions recognition. Higuchi and box-counting algorithms were used for the EEG analysis and comparison. Support Vector Machine classifier was applied for arousal and valence levels recognition. The proposed method is a subject dependent one. Experiments with music and sound stimuli to induce human emotions were realized. Sound clips from the International Affective Digitized Sounds (IADS) database were used in the experiments.

[1]  N. Fox,et al.  Electroencephalogram asymmetry during emotionally evocative films and its relation to positive and negative affectivity , 1992, Brain and Cognition.

[2]  Olga Sourina,et al.  Novel Tools for Quantification of Brain Responses to Music Stimuli , 2009 .

[3]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[4]  Qing Zhang,et al.  Analysis of positive and negative emotions in natural scene using brain activity and GIST , 2009, Neurocomputing.

[5]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[6]  S. Krantz.  Fractal geometry , 1989 .

[7]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[8]  Alexei Sourin,et al.  EEG Data Driven Animation and Its Application , 2009, MIRAGE.

[9]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[10]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[11]  William Stafford Noble,et al.  Support vector machine , 2013 .

[12]  Holger Hoffmann,et al.  EEG: pattern classification during emotional picture processing , 2010, PETRA '10.

[13]  T. Higuchi.  Approach to an irregular time series on the basis of the fractal theory , 1988 .

[14]  Alexei Sourin,et al.  Human electroencephalograms seen as fractal time series: Mathematical analysis and visualization , 2006, Comput. Biol. Medicine.

[15]  F. L. D. Silva,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[16]  J. Russell.  Affective space is bipolar. , 1979 .

[17]  M. Coltheart.  Hemispheric asymmetry , 1978, Nature.

[18]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[19]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[20]  S. Yaacob,et al.  Lifting scheme for human emotion recognition using EEG , 2008, 2008 International Symposium on Information Technology.

[21]  Yuan-Pin Lin,et al.  EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  N. V. Lotova,et al.  Non-linear dynamical coupling between different brain areas during evoked emotions: An EEG investigation , 1998, Biological Psychology.

[23]  N Pradhan,et al.  Use of running fractal dimension for the analysis of changing patterns in electroencephalograms. , 1993, Computers in biology and medicine.

[24]  Turhan Canli,et al.  Individual differences in emotion processing , 2004, Current Opinion in Neurobiology.

[25]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[26]  Olga Sourina,et al.  ANALYSIS AND VISUALIZATION OF HUMAN ELECTROENCEPHALOGRAMS SEEN AS FRACTAL TIME SERIES , 2006 .

[27]  Abdul Wahab,et al.  EEG Emotion Recognition System , 2009 .

[28]  J. Desmond,et al.  Hemispheric asymmetry for emotional stimuli detected with fMRI , 1998, Neuroreport.

[29]  Olga Sourina,et al.  Real-Time EEG-Based Human Emotion Recognition and Visualization , 2010, 2010 International Conference on Cyberworlds.

[30]  Qiang Wang,et al.  EEG-Based "Serious" Games Design for Medical Applications , 2010, 2010 International Conference on Cyberworlds.

[31]  T. Elbert,et al.  The scalp distribution of the fractal dimension of the EEG and its variation with mental tasks , 2005, Brain Topography.