Objective stress monitoring based on wearable sensors in everyday settings

Abstract Monitoring people’s stress levels has become an essential part of behavioural studies for physical and mental illnesses conducted within the biopsychosocial framework. There have been several stress assessment studies in laboratory-based controlled settings. However, the results of these studies do not always translate effectively to an everyday context. The current state of wearable sensor technology allows us to develop systems measuring the physiological signals reflecting stress 24/7 while capturing the context. In this paper, we present a stress monitoring system that provides objective daily stress measurements in everyday settings based on three physiological signals: electrocardiogram (ECG), photoplethysmogram (PPG), and galvanic skin response (GSR) using Shimmer3 ECG, Shimmer3 GSR+, and Empatica E4 wearable sensors. We perform controlled stress assessment experiments on 17 participants in which we successfully detect stress with a 94.55% accuracy for 10-fold cross-validation and an 85.71% accuracy for subject-wise cross-validation. In everyday settings, the system assesses stress with an 81.82% accuracy. We also examine whether motion artefacts affect stress assessment and filter the low-confidence readings to minimise false alarms.

[1]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[2]  Alice Bloch,et al.  Structured methods: Interviews, questionnaires and observation , 2011 .

[3]  Lesya Anishchenko,et al.  Mental stress detection using bioradar respiratory signals , 2018, Biomed. Signal Process. Control..

[4]  W. Bardwell,et al.  Effects of stress on heart rate complexity—A comparison between short-term and chronic stress , 2009, Biological Psychology.

[5]  Yong Deng,et al.  Evaluating feature selection for stress identification , 2012, 2012 IEEE 13th International Conference on Information Reuse & Integration (IRI).

[6]  Aamir Saeed Malik,et al.  A physiological signal-based method for early mental-stress detection , 2018, Biomed. Signal Process. Control..

[7]  D. Bai,et al.  Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature , 2018, Psychiatry investigation.

[8]  Gareth M. James,et al.  Majority vote classifiers: theory and applications , 1998 .

[9]  A. K. Davis,et al.  The use of leukocyte profiles to measure stress in vertebrates: a review for ecologists , 2008 .

[10]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[11]  W. Zareba,et al.  Heart rate variability. , 2013, Handbook of clinical neurology.

[12]  George P. Chrousos,et al.  Perceived Stress Scale: Reliability and Validity Study in Greece , 2011, International journal of environmental research and public health.

[13]  K. Glanz,et al.  Stress, coping, and health behavior. , 2008 .

[14]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[15]  Uri Zwick,et al.  The Memory Game , 1993, Theor. Comput. Sci..

[16]  Misha Pavel,et al.  Evaluation of the accuracy and reliability for photoplethysmography based heart rate and beat-to-beat detection during daily activities , 2017 .

[17]  Paul A. Iaizzo,et al.  Basic ECG Theory, Recordings, and Interpretation , 2005 .

[18]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[19]  Farshad Firouzi,et al.  Internet-of-Things and big data for smarter healthcare: From device to architecture, applications and analytics , 2018, Future Gener. Comput. Syst..

[20]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[21]  Ankit Gupta,et al.  ECG Noise Reduction by Different Filters: A Comparative Analysis , 2015 .

[22]  D. Hand,et al.  Idiot's Bayes—Not So Stupid After All? , 2001 .

[23]  Phyllis K Stein,et al.  Non-Linear Heart Rate Variability and Risk Stratification in Cardiovascular Disease , 2005, Indian pacing and electrophysiology journal.

[24]  R. Couceiro,et al.  Can PPG be used for HRV analysis? , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  Luca Romeo,et al.  Real-time mental stress detection based on smartwatch , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[26]  Arpan Pal,et al.  Classification and quantitative estimation of cognitive stress from in-game keystroke analysis using EEG and GSR , 2017, 2017 IEEE Life Sciences Conference (LSC).

[27]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[28]  R. Klabunde Cardiovascular Physiology Concepts , 2021 .

[29]  F. Shaffer,et al.  Heart Rate Variability: New Perspectives on Physiological Mechanisms, Assessment of Self-regulatory Capacity, and Health risk , 2015, Global advances in health and medicine.

[30]  P. Sterling,et al.  Allostasis: A new paradigm to explain arousal pathology. , 1988 .

[31]  S. Salanterä,et al.  The Internet of Things for basic nursing care-A scoping review. , 2017, International journal of nursing studies.

[32]  Himanshu Thapliyal,et al.  A Survey of Affective Computing for Stress Detection: Evaluating technologies in stress detection for better health , 2016, IEEE Consumer Electronics Magazine.

[33]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[34]  S. Huffel,et al.  Influence of Mental Stress on Heart Rate and Heart Rate Variability , 2009 .

[35]  Niraj K. Jha,et al.  Keep the Stress Away with SoDA: Stress Detection and Alleviation System , 2017, IEEE Transactions on Multi-Scale Computing Systems.

[36]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[37]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[38]  F. Braceland THE STRESS OF LIFE , 1976 .

[39]  Pasi Liljeberg,et al.  A Real-time PPG Quality Assessment Approach for Healthcare Internet-of-Things , 2019, ANT/EDI40.

[40]  T. H. Holmes,et al.  The Social Readjustment Rating Scale. , 1967, Journal of psychosomatic research.

[41]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[42]  Suzanne M. Miller,et al.  The impact of misclassification due to survey response fatigue on estimation and identifiability of treatment effects , 2011, Statistics in medicine.

[43]  B. Kudielka,et al.  Salivary cortisol as a biomarker in stress research , 2009, Psychoneuroendocrinology.

[44]  Mykola Pechenizkiy,et al.  What's Your Current Stress Level? Detection of Stress Patterns from GSR Sensor Data , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[45]  Shao-Kuo Tai,et al.  Emotion stress detection using EEG signal and deep learning technologies , 2018, 2018 IEEE International Conference on Applied System Invention (ICASI).

[46]  J. N. Langley THE AUTONOMIC NERVOUS SYSTEM , 1903 .

[47]  Abdallah Makhoul,et al.  Real-time stress evaluation using wireless body sensor networks , 2018, 2018 Wireless Days (WD).

[48]  Paul A. Iaizzo,et al.  Handbook of Cardiac Anatomy, Physiology, and Devices , 2005, Springer International Publishing.

[49]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[50]  Martin L. Griss,et al.  Activity-Aware Mental Stress Detection Using Physiological Sensors , 2010, MobiCASE.

[51]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[52]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[53]  Arpan Pal,et al.  Eliminating Individual Bias to Improve Stress Detection from Multimodal Physiological Data , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[54]  S. Fisher Stress, health and disease. , 1993, British journal of hospital medicine.

[55]  Ali Motie Nasrabadi,et al.  Ictal Heart Rate Variability Assessment with Focus on Secondary Generalized and Complex Partial Epileptic Seizures , 2013 .

[56]  Hiromitsu Kobayashi,et al.  Effect of measurement duration on accuracy of pulse-counting , 2013, Ergonomics.

[57]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[58]  K. Glanz,et al.  Health behavior and health education : theory, research, and practice , 1991 .