Differences in photoplethysmography morphological features and feature time series between two opposite emotions: Happiness and sadness

Abstract It has been well established that change in emotion state is associated with the change in physiological signals. This paper aimed to investigate the differences of finger photoplethysmography (PPG) morphological features and feature time series between happiness and sadness emotion states. Fifty-three volunteers were enrolled. Finger PPG signals were recorded under two emotion states with a random measurement order (first happiness emotion measurement then sadness or reverse). Seven morphological features were extracted, including three temporal features (T, T 1 and T 2 ), three area features (A, A 1 and A 2 ) and one amplitude feature (Amp). Five variability indices from the 5-min feature time series were calculated, including two time-domain indices (SDNN and RMSSD) and three frequency-domain indices (LFn, HFn and LF/HF). Results showed that temporal features T 2 and T were critical features for identifying the two emotion states since not only they themselves but also their three frequency-domain variability indices had significant differences between the two emotion states. For area features, only two frequency-domain variability indices of LFn and HFn for A 1 feature time series reported significant differences. Amplitude feature Amp itself, as well as its variability indices, did not had significant differences between the two emotion states. These results indicated that temporal features were more sensitive to response to emotion change than area and amplitude features. Moreover, compared with time-domain variability indices, frequency-domain variability indices were more suitable for short-term 5-min time series analysis for exploring the inherent but slight change due to the emotion effect.

[1]  F. Benuzzi,et al.  Recognition of emotions from faces and voices in medial temporal lobe epilepsy , 2011, Epilepsy & Behavior.

[2]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[3]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[4]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[5]  T. Baumgartner,et al.  From emotion perception to emotion experience: emotions evoked by pictures and classical music. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  Yunong Wu Member,et al.  Three predictions are better than one: Sentence multi-emotion analysis from different perspectives , 2014 .

[7]  Kenji Kita,et al.  Three predictions are better than one: Sentence multi‐emotion analysis from different perspectives , 2014 .

[8]  Ian B Hickie,et al.  Heart rate variability is associated with emotion recognition: direct evidence for a relationship between the autonomic nervous system and social cognition. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  Min Woo Park,et al.  Individual Emotion Classification between Happiness and Sadness by Analyzing Photoplethysmography and Skin Temperature , 2013, 2013 Fourth World Congress on Software Engineering.

[10]  Kazuhiko Takahashi,et al.  Computational emotion recognition using multimodal physiological signals: Elicited using Japanese kanji words , 2012, 2012 35th International Conference on Telecommunications and Signal Processing (TSP).

[11]  Ning Liu,et al.  Using the multi-parameter variability of photoplethysmographic signals to evaluate short-term cardiovascular regulation , 2015, Journal of Clinical Monitoring and Computing.

[12]  Byoung-Jun Park,et al.  Emotion classification based on bio-signals emotion recognition using machine learning algorithms , 2014, 2014 International Conference on Information Science, Electronics and Electrical Engineering.

[13]  Chuan-Yu Chang,et al.  Physiological emotion analysis using support vector regression , 2013, Neurocomputing.

[14]  Christos D. Katsis,et al.  An integrated system based on physiological signals for the assessment of affective states in patients with anxiety disorders , 2011, Biomed. Signal Process. Control..

[15]  Ioannis Patras,et al.  Fusion of facial expressions and EEG for implicit affective tagging , 2013, Image Vis. Comput..

[16]  Björn W. Schuller,et al.  Emotion on the Road - Necessity, Acceptance, and Feasibility of Affective Computing in the Car , 2010, Adv. Hum. Comput. Interact..

[17]  Kyung-Ah Kim,et al.  Human Sensibility Evaluation Using Photoplethysmogram (PPG) , 2009, 2009 International Conference on Complex, Intelligent and Software Intensive Systems.

[18]  Ana Tajadura-Jiménez,et al.  When room size matters: acoustic influences on emotional responses to sounds. , 2010, Emotion.

[19]  Mohd. Alauddin Mohd. Ali,et al.  The Analysis of PPG Morphology: Investigating the Effects of Aging on Arterial Compliance , 2012 .

[20]  Marko Horvat,et al.  Comparative analysis of emotion estimation methods based on physiological measurements for real-time applications , 2014, Int. J. Hum. Comput. Stud..

[21]  K. Berridge,et al.  Differential subjective and psychophysiological responses to socially and nonsocially generated emotional stimuli. , 2006, Emotion.

[22]  G.D. Pinna,et al.  Effects of record length selection on the accuracy of spectral estimates of heart rate variability: a simulation study , 1996, IEEE Transactions on Biomedical Engineering.

[23]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  P. Drummond,et al.  The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians. , 2001, Psychophysiology.

[25]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  M. Hariharan,et al.  Human Affective (Emotion) behaviour analysis using speech signals: A review , 2012, 2012 International Conference on Biomedical Engineering (ICoBE).

[27]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[28]  Paul Richard,et al.  Emotion assessment for affective computing based on physiological responses , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[29]  A. Ghasemi,et al.  Normality Tests for Statistical Analysis: A Guide for Non-Statisticians , 2012, International journal of endocrinology and metabolism.

[30]  Isabelle Peretz,et al.  Role of tempo entrainment in psychophysiological differentiation of happy and sad music? , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[31]  Yaacob Sazali,et al.  Classification of human emotion from EEG using discrete wavelet transform , 2010 .