Indices from lagged poincare plots of heart rate variability: an efficient nonlinear tool for emotion discrimination

Interest in human emotion recognition, regarding physiological signals, has recently risen. In this study, an efficient emotion recognition system, based on geometrical analysis of autonomic nervous system signals, is presented. The electrocardiogram recordings of 47 college students were obtained during rest condition and affective visual stimuli. Pictures with four emotional contents, including happiness, peacefulness, sadness, and fear were selected. Then, ten lags of Poincare plot were constructed for heart rate variability (HRV) segments. For each lag, five geometrical indices were extracted. Next, these features were fed into an automatic classification system for the recognition of the four affective states and rest condition. The results showed that the Poincare plots have different shapes for different lags, as well as for different affective states. Considering higher lags, the greatest increment in SD1 and decrements in SD2 occurred during the happiness stimuli. In contrast, the minimum changes in the Poincare measures were perceived during the fear inducements. Therefore, the HRV geometrical shapes and dynamics were altered by the positive and negative values of valence-based emotion dimension. Using a probabilistic neural network, a maximum recognition rate of 97.45% was attained. Applying the proposed methodology based on lagged Poincare indices, a valuable tool for discriminating the emotional states was provided.

[1]  Tapobrata Lahiri,et al.  Analysis of ECG signal by chaos principle to help automatic diagnosis of myocardial infarction , 2009 .

[2]  M. Murugappan,et al.  Classification of emotional states from electrocardiogram signals: a non-linear approach based on hurst , 2013, BioMedical Engineering OnLine.

[3]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[4]  Saeed Rahati Quchani,et al.  Analysis of lagged Poincaré plots in heart rate signals during meditation , 2011, Digit. Signal Process..

[5]  A. Wykrętowicz,et al.  Correlations between the Poincaré plot and conventional heart rate variability parameters assessed during paced breathing. , 2007, The journal of physiological sciences : JPS.

[6]  Xiaoran Sun,et al.  A simple way of distinguishing chaotic characteristics in ECG signals , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[7]  Luca Citi,et al.  Revealing Real-Time Emotional Responses: a Personalized Assessment based on Heartbeat Dynamics , 2014, Scientific Reports.

[8]  Sylvia D. Kreibig,et al.  Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. , 2007, Psychophysiology.

[9]  Luiz Carlos de Abreu,et al.  Auditory stimulation with music influences the geometric indices of heart rate variability in men , 2014, International archives of medicine.

[10]  E. Sokhadze Effects of Music on the Recovery of Autonomic and Electrocortical Activity After Stress Induced by Aversive Visual Stimuli , 2007, Applied psychophysiology and biofeedback.

[11]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[12]  Ataollah Abbasi,et al.  Evaluating Autonomic Parameters: The Role of Sleep ‎Duration in Emotional Responses to Music ‎ , 2016, Iranian Journal of Psychiatry.

[13]  Ahmad R. Sharafat,et al.  Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals , 2015, Comput. Methods Programs Biomed..

[14]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Wolzt,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2003, The Journal of the American College of Dentists.

[16]  D. Dougherty,et al.  Autonomic and prefrontal cortex responses to autobiographical recall of emotions , 2007, Cognitive, affective & behavioral neuroscience.

[17]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Björn Schuller,et al.  Emotion Recognition in the Noise Applying Large Acoustic Feature Sets , 2006 .

[19]  T. Dalgleish Basic Emotions , 2004 .

[20]  Mohammad Soleymani,et al.  Affective ranking of movie scenes using physiological signals and content analysis , 2008, MS '08.

[21]  Laurita dos Santos,et al.  Influence of the hrv time series length on the predictive ability for adverse clinical events , 2013 .

[22]  B. Schmeichel,et al.  Behavioural, affective, and physiological effects of negative and positive emotional exaggeration , 2004 .

[23]  Mohamed Chetouani,et al.  Hilbert-Huang transform based physiological signals analysis for emotion recognition , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[24]  K. Scherer,et al.  Psychophysiological responses to appraisal dimensions in a computer game , 2004 .

[25]  Sazali Yaacob,et al.  Electrocardiogram‐based emotion recognition system using empirical mode decomposition and discrete Fourier transform , 2014, Expert Syst. J. Knowl. Eng..

[26]  S. Vrana,et al.  The role of ethnicity, gender, emotional content, and contextual differences in physiological, expressive, and self-reported emotional responses to imagery , 2002 .

[27]  Jarosław Piskorski,et al.  Filtering Poincaré plots , 2005 .

[28]  Ginevra Castellano,et al.  Recognising Human Emotions from Body Movement and Gesture Dynamics , 2007, ACII.

[29]  Qiang Chen,et al.  Research on genetic algorithm based on emotion recognition using physiological signals , 2011, 2011 International Conference on Computational Problem-Solving (ICCP).

[30]  Luiz Carlos de Abreu,et al.  The effects of auditory stimulation with music on heart rate variability in healthy women , 2013, Clinics.

[31]  Gyanendra K. Verma,et al.  Multimodal fusion framework: A multiresolution approach for emotion classification and recognition from physiological signals , 2014, NeuroImage.

[32]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[33]  T. Scherer,et al.  Constraints for emotion specificity in fear and anger: the context counts. , 2001, Psychophysiology.

[34]  Enzo Pasquale Scilingo,et al.  Recognizing Emotions Induced by Affective Sounds through Heart Rate Variability , 2015, IEEE Transactions on Affective Computing.

[35]  E. Scilingo,et al.  Dominant Lyapunov exponent and approximate entropy in heart rate variability during emotional visual elicitation , 2012, Front. Neuroeng..

[36]  Atefeh Goshvarpour,et al.  Affective Visual Stimuli: Characterization of the Picture Sequences Impacts by Means of Nonlinear Approaches , 2015, Basic and clinical neuroscience.

[37]  Chuan-Yu Chang,et al.  Based on Support Vector Regression for emotion recognition using physiological signals , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[38]  D. Tranel,et al.  Gastric myoelectrical activity as an index of emotional arousal. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[39]  Isabelle Peretz,et al.  Role of tempo entrainment in psychophysiological differentiation of happy and sad music? , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[40]  Alan F. Smeaton,et al.  Biometric Responses to Music-Rich Segments in Films: The CDVPlex , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[41]  David Sander,et al.  A systems approach to appraisal mechanisms in emotion , 2005, Neural Networks.

[42]  Eduardo Serrano,et al.  Characterization of a clinical olfactory test with an artificial nose , 2011, Front. Neuroeng..

[43]  V. Valenti,et al.  Stabilometric parameters analysis in children with visual disorder , 2014, International archives of medicine.

[44]  Atefeh Goshvarpour,et al.  Poincare indices for analyzing meditative heart rate signals , 2015, Biomedical journal.

[45]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[46]  N. Izeboudjen,et al.  APPLICATION OF A PROBABILISTIC NEURAL NETWORK FOR CLASSIFICATION OF CARDIAC ARRHYTHMIAS , 2009 .

[47]  T. Seppänen,et al.  Quantitative beat-to-beat analysis of heart rate dynamics during exercise. , 1996, The American journal of physiology.

[48]  F. Wilhelm,et al.  Identifying anxiety states using broad sampling and advanced processing of peripheral physiological information. , 2006, Biomedical sciences instrumentation.

[49]  Pere Caminal,et al.  Methods derived from nonlinear dynamics for analysing heart rate variability , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[50]  Sungwon Park,et al.  Physiological reactivity and facial expression to emotion-inducing films in patients with schizophrenia. , 2011, Archives of psychiatric nursing.

[51]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[52]  Hideki Ohira,et al.  Influence of Attention Manipulation on Emotion and Autonomic Responses , 2007, Perceptual and motor skills.