Modelling Naturalistic Work Stress Using Spectral HRV Representations and Deep Learning

This is an extension from a selected paper from JSAI2019. With the proliferation of wearable devices and the inflow of new health data, artificial intelligence is expected to revolutionize the field of wellness and health management by providing potential tools for analyzing harmful conditions like prolonged stress. Currently, one of the standard measurements used by medical practitioners to measure stress is heart rate variability (HRV), a set of numerical indices that reflect autonomic balance. However, recent advances in machine learning have shown that learned features tend to outperform hand-crafted features. In this work we propose a more expressive intermediate data representation based on Lomb-Scargle periodograms combined with the feature learning capabilities of deep learning. Using stress data from naturalistic work activities, we tested different shallow and deep learning architectures and show that significant improvements can be achieved compared to traditional HRV indices. Results show that models trained on our spectral-temporal representation significantly outperform models trained on traditional HRV indices for predicting naturalistic work stress.

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  George B. Moody,et al.  Spectral analysis of heart rate without resampling , 1993, Proceedings of Computers in Cardiology Conference.

[3]  S. Saxena,et al.  Depression: a global public health concern , 2012 .

[4]  Lionel Tarassenko,et al.  Quantifying errors in spectral estimates of HRV due to beat replacement and resampling , 2005, IEEE Transactions on Biomedical Engineering.

[5]  J. Vanderplas Understanding the Lomb–Scargle Periodogram , 2017, 1703.09824.

[6]  Lonce L. Wyse,et al.  Real-Time Signal Estimation From Modified Short-Time Fourier Transform Magnitude Spectra , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[7]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[8]  P. Melillo,et al.  Nonlinear Heart Rate Variability features for real-life stress detection. Case study: students under stress due to university examination , 2011, Biomedical engineering online.

[9]  J. Thayer,et al.  eview meta-analysis of heart rate variability and neuroimaging studies : Implications or heart rate variability as a marker of stress and health , 2012 .

[10]  Athanasios V. Vasilakos,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proceedings of the IEEE.

[11]  D. Bai,et al.  Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature , 2018, Psychiatry investigation.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  A. Tamakoshi,et al.  Perceived Mental Stress and Mortality From Cardiovascular Disease Among Japanese Men and Women: The Japan Collaborative Cohort Study for Evaluation of Cancer Risk Sponsored by Monbusho (JACC Study) , 2002, Circulation.

[14]  George Trigeorgis,et al.  End-to-End Multimodal Emotion Recognition Using Deep Neural Networks , 2017, IEEE Journal of Selected Topics in Signal Processing.

[15]  T. Deeming Fourier analysis with unequally-spaced data , 1975 .

[16]  Dhanjoo N. Ghista,et al.  Heart rate variability power spectrogram as a potential noninvasive signature of cardiac regulatory system response, mechanisms, and disorders , 1987, Heart and Vessels.

[17]  J. Scargle Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .