A novel multi-kernel 1D convolutional neural network for stress recognition from ECG

Stress is an emotional state which although experienced in a subjective way, it shares specific common characteristics. Objective stress recognition has proven to be a complicated issue, due to the number of parameters involved. Thus, the investigation of reliable indices associated with the stress response is of utmost importance. Heart activity may provide useful information towards this goal. Traditional machine learning techniques have been used in the area of emotion recognition but they sometimes present specific limitations. The emergence of Deep Learning (DL) techniques permits the reveal underlying patterns in electrocardiography (ECG) which, otherwise, would not be easily observed. The proposed DL architecture utilizes a variety of kernels per module to compute complex feature maps and enables a multi-level modelling of the unique heart rate variability signature for stress state identification. The proposed methodology using 6-fold cross-validation outperforms single kernel networks achieving classification accuracy up to 99.1%, better overall performance (avg. F1-score 88.1%, avg. accuracy 89.8%) and more consistent behaviour across study's experimental phases.

[1]  Manolis Tsiknakis,et al.  Stress and anxiety detection using facial cues from videos , 2017, Biomed. Signal Process. Control..

[2]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[3]  Manolis Tsiknakis,et al.  Detection of stress/anxiety state from EEG features during video watching , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Daniel McDuff,et al.  COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera , 2016, CHI.

[5]  Manolis Tsiknakis,et al.  Review on Psychological Stress Detection Using Biosignals , 2019, IEEE Transactions on Affective Computing.

[6]  Manolis Tsiknakis,et al.  A stress recognition system using HRV parameters and machine learning techniques , 2019, 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW).

[7]  Stuart Semple,et al.  Displacement behaviour regulates the experience of stress in men , 2013, Stress.

[8]  Hatice Gunes,et al.  Bi-modal emotion recognition from expressive face and body gestures , 2007, J. Netw. Comput. Appl..

[9]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[10]  Daniel McDuff,et al.  Remote measurement of cognitive stress via heart rate variability , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Bogdan J. Matuszewski,et al.  Wize Mirror - a smart, multisensory cardio-metabolic risk monitoring system , 2016, Comput. Vis. Image Underst..

[12]  HwangBosun,et al.  Deep ECGNet: An Optimal Deep Learning Framework for Monitoring Mental Stress Using Ultra Short-Term ECG Signals. , 2018 .

[13]  Mohamed Chetouani,et al.  Multimodal Stress Detection from Multiple Assessments , 2018, IEEE Transactions on Affective Computing.

[14]  Khalid Masood,et al.  Modeling Mental Stress Using a Deep Learning Framework , 2019, IEEE Access.

[15]  P. Sleight,et al.  Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability. , 2000, Journal of the American College of Cardiology.

[16]  Myeong Gi Jeong,et al.  Ultra Short Term Analysis of Heart Rate Variability for Monitoring Mental Stress in Mobile Settings , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.