Nonlinear Methodologies Applied to Automatic Recognition of Emotions: An EEG Review

Development of algorithms for automatic detection of emotions is essential to improve affective skills of human-computer interfaces. In the literature, a wide variety of linear methodologies have been applied with the aim of defining the brain’s performance under different emotional states. Nevertheless, recent findings have demonstrated the nonlinear and dynamic behavior of the brain. Thus, the use of nonlinear analysis techniques has notably increased, reporting promising results with respect to traditional linear methods. In this sense, this work presents a review of the latest advances in the field, exploring the main nonlinear metrics used for emotion recognition from EEG recordings.

[1]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Stefanie Rukavina,et al.  Affective Computing and the Impact of Gender and Age , 2016, PloS one.

[3]  Yingying Tang,et al.  Abnormal functional connectivity of EEG gamma band in patients with depression during emotional face processing , 2015, Clinical Neurophysiology.

[4]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[5]  Hamdi Melih Saraoglu,et al.  Feature extraction for EEG based emotion prediction applications through chaotic analysis , 2015, 2015 19th National Biomedical Engineering Meeting (BIYOMUT).

[6]  Sümeyra Agambayev,et al.  Nonlinear analysis of EEGs of patients with major depression during different emotional states , 2015, Comput. Biol. Medicine.

[7]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[8]  L. Schmidt,et al.  Cross-regional cortical synchronization during affective image viewing , 2010, Brain Research.

[9]  K. Aminian,et al.  Nonlinear analysis of human physical activity patterns in health and disease. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Aydin Akan,et al.  Emotion recognition from EEG signals by using multivariate empirical mode decomposition , 2018, Pattern Analysis and Applications.

[11]  Aravind E. Vijayan,et al.  EEG-Based Emotion Recognition Using Statistical Measures and Auto-Regressive Modeling , 2015, 2015 IEEE International Conference on Computational Intelligence & Communication Technology.

[12]  Olga Sourina,et al.  Real-time EEG-based emotion monitoring using stable features , 2015, The Visual Computer.

[13]  José Manuel Pastor,et al.  Arousal Level Classification in the Ageing Adult by Measuring Electrodermal Skin Conductivity , 2015, AmIHEALTH.

[14]  Olga Sourina,et al.  A Fractal-based Algorithm of Emotion Recognition from EEG using Arousal-Valence Model , 2011, BIOSIGNALS.

[15]  Antonio Fernández-Caballero,et al.  Neural Correlates of Phrase Rhythm: An EEG Study of Bipartite vs. Rondo Sonata Form , 2017, Front. Neuroinform..

[16]  Zahra Khalili,et al.  Emotion recognition system using brain and peripheral signals: Using correlation dimension to improve the results of EEG , 2009, 2009 International Joint Conference on Neural Networks.

[17]  Ramchandra Manthalkar,et al.  Effect of meditation on emotional response: An EEG-based study , 2017, Biomed. Signal Process. Control..

[18]  G Tononi,et al.  Theoretical neuroanatomy: relating anatomical and functional connectivity in graphs and cortical connection matrices. , 2000, Cerebral cortex.

[19]  S. A. Hosseini,et al.  Emotion recognition method using entropy analysis of EEG signals , 2011 .

[20]  J. Russell.  A circumplex model of affect. , 1980 .

[21]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[22]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[23]  Rosalind W. Picard.  Affective Computing , 1997 .

[24]  José Manuel Pastor,et al.  Arousal level classification of the aging adult from electro-dermal activity: From hardware development to software architecture , 2017, Pervasive Mob. Comput..

[25]  J. R. Moorman,et al.  Accurate estimation of entropy in very short physiological time series: the problem of atrial fibrillation detection in implanted ventricular devices. , 2011, American journal of physiology. Heart and circulatory physiology.

[26]  Hamed Azami,et al.  Amplitude-aware permutation entropy: Illustration in spike detection and signal segmentation , 2016, Comput. Methods Programs Biomed..

[27]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[28]  Muralidhar G. Bairy,et al.  Nonlinear Analysis of Physiological Signals: A Review , 2012 .

[29]  Kenneth Sundaraj,et al.  Optimal set of EEG features for emotional state classification and trajectory visualization in Parkinson's disease. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  Hao Guo,et al.  Novel Algorithm for Measuring the Complexity of Electroencephalographic Signals in Emotion Recognition , 2017 .

[31]  Stefan Haufe,et al.  The effect of linear mixing in the EEG on Hurst exponent estimation , 2014, NeuroImage.

[32]  José Manuel Pastor,et al.  Smart environment architecture for emotion detection and regulation , 2016, J. Biomed. Informatics.

[33]  Brian Litt,et al.  A comparison of waveform fractal dimension algorithms , 2001 .

[34]  Paul Symonds,et al.  How feasible is implementation of distress screening by cancer clinicians in routine clinical care? , 2012, Cancer.

[35]  Li Li,et al.  Emotion recognition based on the sample entropy of EEG. , 2014, Bio-medical materials and engineering.

[36]  Antonio Fernández-Caballero,et al.  Facial expression recognition in ageing adults: from lab to ambient assisted living , 2017, J. Ambient Intell. Humaniz. Comput..

[37]  Olga Sourina,et al.  EEG-based subject-dependent emotion recognition algorithm using fractal dimension , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[38]  Jiang Wang,et al.  Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy. , 2015, Chaos.

[39]  Li Li,et al.  Comparative study of approximate entropy and sample entropy in EEG data analysis , 2013 .

[40]  Reza Rostami,et al.  Classifying depression patients and normal subjects using machine learning techniques , 2011, 2011 19th Iranian Conference on Electrical Engineering.

[41]  J. Russell,et al.  Facial and vocal expressions of emotion. , 2003, Annual review of psychology.

[42]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[43]  Mohammad A. Khalilzadeh,et al.  EMOTIONAL STRESS RECOGNITION SYSTEM FOR AFFECTIVE COMPUTING BASED ON BIO-SIGNALS , 2010 .

[44]  P. Garc,et al.  Analysis of EEG Signals using Nonlinear Dynamics and Chaos: A review , 2015 .

[45]  Marija Mitrovic,et al.  Co-Evolutionary Mechanisms of Emotional Bursts in Online Social Dynamics and Networks , 2013, Entropy.

[46]  Ian Daly,et al.  Neural correlates of emotional responses to music: An EEG study , 2014, Neuroscience Letters.

[47]  P. Ekman.  An argument for basic emotions , 1992 .

[48]  Subha D. Puthankattil,et al.  Analysis of EEG Signals Using Wavelet Entropy and Approximate Entropy: A Case Study on Depression Patients , 2014 .

[49]  José Manuel Pastor,et al.  Symbolic Analysis of Brain Dynamics Detects Negative Stress , 2017, Entropy.

[50]  Bin Hu,et al.  A method of identifying chronic stress by EEG , 2012, Personal and Ubiquitous Computing.

[51]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[52]  Angelo Gemignani,et al.  The dynamics of EEG gamma responses to unpleasant visual stimuli: From local activity to functional connectivity , 2012, NeuroImage.

[53]  José Manuel Pastor,et al.  Application of Entropy-Based Metrics to Identify Emotional Distress from Electroencephalographic Recordings , 2016, Entropy.

[54]  D. N. Tibarewala,et al.  EEG based emotion recognition system using MFDFA as feature extractor , 2015, 2015 International Conference on Robotics, Automation, Control and Embedded Systems (RACE).

[55]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  Suhua Zhang,et al.  An approach to EEG-based emotion recognition using combined feature extraction method , 2016, Neuroscience Letters.

[57]  S. Hsieh,et al.  Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns , 2014, PloS one.

[58]  A. M. Nasrabadi,et al.  Recognition of emotional states induced by music videos based on nonlinear feature extraction and SOM classification , 2014, 2014 21th Iranian Conference on Biomedical Engineering (ICBME).

[59]  Martin Buss,et al.  Feature Extraction and Selection for Emotion Recognition from EEG , 2014, IEEE Transactions on Affective Computing.

[60]  R. Nagarajan,et al.  Combining Spatial Filtering and Wavelet Transform for Classifying Human Emotions Using EEG Signals , 2011 .

[61]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[62]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[63]  Sima Hoseingholizade,et al.  Studying emotion through nonlinear processing of EEG , 2012 .