Ambulatory and Laboratory Stress Detection Based on Raw Electrocardiogram Signals Using a Convolutional Neural Network

The goals of this study are the suggestion of a better classification method for detecting stressed states based on raw electrocardiogram (ECG) data and a method for training a deep neural network (DNN) with a smaller data set. We suggest an end-to-end architecture to detect stress using raw ECGs. The architecture consists of successive stages that contain convolutional layers. In this study, two kinds of data sets are used to train and validate the model: A driving data set and a mental arithmetic data set, which smaller than the driving data set. We apply a transfer learning method to train a model with a small data set. The proposed model shows better performance, based on receiver operating curves, than conventional methods. Compared with other DNN methods using raw ECGs, the proposed model improves the accuracy from 87.39% to 90.19%. The transfer learning method improves accuracy by 12.01% and 10.06% when 10 s and 60 s of ECG signals, respectively, are used in the model. In conclusion, our model outperforms previous models using raw ECGs from a small data set and, so, we believe that our model can significantly contribute to mobile healthcare for stress management in daily life.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[4]  B. Appelhans,et al.  Heart Rate Variability as an Index of Regulated Emotional Responding , 2006 .

[5]  Shigeki Sugano,et al.  Multiclass Classification of Driver Perceived Workload Using Long Short-Term Memory based Recurrent Neural Network , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[6]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[7]  J. Sztajzel.  Heart rate variability: a noninvasive electrocardiographic method to measure the autonomic nervous system. , 2004, Swiss medical weekly.

[8]  HwangBosun,et al.  Deep ECGNet: An Optimal Deep Learning Framework for Monitoring Mental Stress Using Ultra Short-Term ECG Signals. , 2018 .

[9]  R. Mccraty,et al.  The effects of emotions on short-term power spectrum analysis of heart rate variability . , 1995, The American journal of cardiology.

[10]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[11]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[12]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[13]  Byoung-Tak Zhang,et al.  Deep ECGNet: An Optimal Deep Learning Framework for Monitoring Mental Stress Using Ultra Short-Term ECG Signals. , 2018, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[14]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[15]  U. Rajendra Acharya,et al.  Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network , 2017, Inf. Sci..

[16]  Sheldon Cohen,et al.  Psychological stress and disease. , 2007, JAMA.

[17]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[18]  Elena Smets,et al.  Into the Wild: The Challenges of Physiological Stress Detection in Laboratory and Ambulatory Settings , 2019, IEEE Journal of Biomedical and Health Informatics.

[19]  Yorgos Goletsis,et al.  Real-Time Driver's Stress Event Detection , 2012, IEEE Transactions on Intelligent Transportation Systems.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Inchan Youn,et al.  A Novel R Peak Detection Method for Mobile Environments , 2018, IEEE Access.

[22]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[23]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[24]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[25]  Tanir Ozcelebi,et al.  Model Adaptation and Personalization for Physiological Stress Detection , 2018, 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA).

[26]  Man-Wai Mak,et al.  Towards End-to-End ECG Classification With Raw Signal Extraction and Deep Neural Networks , 2019, IEEE Journal of Biomedical and Health Informatics.

[27]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[28]  J. Holland,et al.  Screening for psychologic distress in ambulatory cancer patients , 2005, Cancer.

[29]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[30]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[32]  P. Melillo,et al.  Detection of mental stress due to oral academic examination via ultra-short-term HRV analysis , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  Chris Van Hoof,et al.  Comparison of Machine Learning Techniques for Psychophysiological Stress Detection , 2015, MindCare.

[34]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[35]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .