Human Emotion Characterization by Heart Rate Variability Analysis Guided by Respiration

Developing a tool that identifies emotions based on their effect on cardiac activity may have a potential impact on clinical practice, since it may help in the diagnosing of psycho-neural illnesses. In this study, a method based on the analysis of heart rate variability (HRV) guided by respiration is proposed. The method was based on redefining the high frequency (HF) band, not only to be centered at the respiratory frequency, but also to have a bandwidth dependent on the respiratory spectrum. The method was first tested using simulated HRV signals, yielding the minimum estimation errors as compared to classic and respiratory frequency centered at HF band based definitions, independently of the values of the sympathovagal ratio. Then, the proposed method was applied to discriminate emotions in a database of video-induced elicitation. Five emotional states, relax, joy, fear, sadness, and anger, were considered. The maximum correlation between HRV and respiration spectra discriminated joy versus relax, joy versus each negative valence emotion, and fear versus sadness with <italic>p</italic>-value <inline-formula><tex-math notation="LaTeX">$\leq$</tex-math></inline-formula> 0.05 and AUC <inline-formula><tex-math notation="LaTeX">$\geq$</tex-math></inline-formula> 0.70. Based on these results, human emotion characterization may be improved by adding respiratory information to HRV analysis.

[1]  Mohammad Soleymani,et al.  Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection , 2016, IEEE Transactions on Affective Computing.

[2]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[3]  N. N. Sudheesh,et al.  Investigation into the effects of music and meditation on galvanic skin response , 2000 .

[4]  M. Fullana,et al.  Looking at the heart of low and high heart rate variability fearful flyers: self-reported anxiety when confronting feared stimuli , 2005, Biological Psychology.

[5]  Ian B Hickie,et al.  Heart rate variability is associated with emotion recognition: direct evidence for a relationship between the autonomic nervous system and social cognition. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  D. Erik Everhart,et al.  Healthy high-hostiles: reduced parasympathetic activity and decreased sympathovagal flexibility during negative emotional processing , 2004 .

[7]  Pablo Laguna,et al.  Human emotion recognition using heart rate variability analysis with spectral bands based on respiration , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Solange Akselrod,et al.  Individual time-dependent spectral boundaries for improved accuracy in time-frequency analysis of heart rate variability , 2006, IEEE Transactions on Biomedical Engineering.

[9]  Jesús Lázaro,et al.  Measuring acute stress response through physiological signals: towards a quantitative assessment of stress , 2018, Medical & Biological Engineering & Computing.

[10]  Pablo Laguna,et al.  A robust method for ECG-based estimation of the respiratory frequency during stress testing , 2006, IEEE Transactions on Biomedical Engineering.

[11]  Enzo Pasquale Scilingo,et al.  Wearable Monitoring for Mood Recognition in Bipolar Disorder Based on History-Dependent Long-Term Heart Rate Variability Analysis , 2014, IEEE Journal of Biomedical and Health Informatics.

[12]  Pablo Laguna,et al.  Non-linear HRV indices under autonomic nervous system blockade , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  L. Sornmo,et al.  Analysis of Heart Rate Variability Using Time-Varying Frequency Bands Based on Respiratory Frequency , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  W. Rice ANALYZING TABLES OF STATISTICAL TESTS , 1989, Evolution; international journal of organic evolution.

[15]  J. Mcanulty,et al.  CARDIOVASCULAR PHYSIOLOGY , 1981, Clinical obstetrics and gynecology.

[16]  Pablo Laguna,et al.  The Integral Pulse Frequency Modulation Model With Time-Varying Threshold: Application to Heart Rate Variability Analysis During Exercise Stress Testing , 2011, IEEE Transactions on Biomedical Engineering.

[17]  Egidijus Kazanavičius,et al.  Emotion Recognition in Human Computer Interaction Systems , 2014 .

[18]  Pablo Laguna,et al.  Analysis of heart rate variability in the presence of ectopic beats using the heart timing signal , 2003, IEEE Transactions on Biomedical Engineering.

[19]  F. Yasuma,et al.  Respiratory sinus arrhythmia: why does the heartbeat synchronize with respiratory rhythm? , 2004, Chest.

[20]  Enzo Pasquale Scilingo,et al.  Oscillations of Heart Rate and Respiration Synchronize During Affective Visual Stimulation , 2012, IEEE Transactions on Information Technology in Biomedicine.

[21]  Jesús Lázaro,et al.  Inclusion of Respiratory Frequency Information in Heart Rate Variability Analysis for Stress Assessment , 2016, IEEE Journal of Biomedical and Health Informatics.

[22]  Pablo Laguna,et al.  A multivariate time-frequency method to characterize the influence of respiration over heart period and arterial pressure , 2012, EURASIP J. Adv. Signal Process..

[23]  Sven C. Martin,et al.  Statistical Language Modeling Using Leaving-One-Out , 1997 .

[24]  L. Blanch,et al.  Feasibility and safety of virtual-reality-based early neurocognitive stimulation in critically ill patients , 2017, Annals of Intensive Care.

[25]  Thomas Kubiak,et al.  The impact of heart rate variability on subjective well-being is mediated by emotion regulation , 2010 .

[26]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[27]  Nitin Kumar,et al.  Bispectral Analysis of EEG for Emotion Recognition , 2015, IHCI.

[28]  Pablo Laguna,et al.  A wavelet-based ECG delineator: evaluation on standard databases , 2004, IEEE Transactions on Biomedical Engineering.

[29]  David Watson,et al.  The PANAS-X manual for the positive and negative affect schedule , 1994 .

[30]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[31]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[32]  Tapio Seppänen,et al.  Heart Rate Variability (HRV) reflecting from oral reports of negative experience , 2010 .

[33]  Pablo Laguna,et al.  Synthesis of HRV signals characterized by predetermined time-frequency structure by means of time-varying ARMA models , 2012, Biomed. Signal Process. Control..

[34]  Costanza Papagno,et al.  Timing of emotion representation in right and left occipital region: Evidence from combined TMS-EEG , 2016, Brain and Cognition.

[35]  Pablo Laguna,et al.  Characterization of Dynamic Interactions Between Cardiovascular Signals by Time-Frequency Coherence , 2012, IEEE Transactions on Biomedical Engineering.

[36]  A. Finset,et al.  A case study of vocal features associated with galvanic skin response to stressors in a clinical interaction. , 2016, Patient education and counseling.

[37]  Amir B. Geva,et al.  Autonomic dysregulation in panic disorder and in post-traumatic stress disorder: application of power spectrum analysis of heart rate variability at rest and in response to recollection of trauma or panic attacks , 2000, Psychiatry Research.

[38]  Oliver G. B. Garrod,et al.  Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time , 2014, Current Biology.

[39]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[40]  S. Silbernagl,et al.  Color atlas of physiology , 1981 .

[41]  P. Ekman An argument for basic emotions , 1992 .

[42]  Philippe Ravier,et al.  Use of cardiorespiratory coherence to separate spectral bands of the heart rate variability , 2018, Biomed. Signal Process. Control..

[43]  Pablo Laguna,et al.  Analysis of heart rate variability during exercise stress testing using respiratory information , 2010, Biomed. Signal Process. Control..