Non-contact measurement of mental stress via heart rate variability

Non-contact detection of mental stress based on physiological parameters has many potential application areas, such as measuring stress in athletic contest. Non-contact detection could measure mental stress without drawing the attention of subjects. And compared with questionnaire survey, mental stress measurement based on physiological parameters is more objective. In this paper, we introduced a non-contact method to measure mental stress via heart rate variability (HRV). We conducted an experiment with 29 participants at rest and under stress. And a mental arithmetic test was employed to induce stress. To extract HRV, we recorded videos on subjects’ faces by a color CCD camera. HRV was extracted from these videos by imaging photoplethysmography (IPPG). The results showed that HRV was significantly different between normal and stressed conditions. Then we performed significance test and independence test to select the features which could be used in mental stress measurement. Finally, nine features were used to measure mental stress. In order to establish a stress measurement model, support vector machines (SVM) was used to establish a binary classifier for stress detection and the accuracy of the model was 78.2%. Compared with other methods, our method took non-linear features of HRV into consideration. The method we proposed supports the application of non-contact mental stress detection.

[1]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[2]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  S. Segerstrom,et al.  Psychological stress and the human immune system: a meta-analytic study of 30 years of inquiry. , 2004, Psychological bulletin.

[4]  A. Barreto,et al.  Stress Detection in Computer Users Based on Digital Signal Processing of Noninvasive Physiological Variables , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Javier Hernandez,et al.  Call Center Stress Recognition with Person-Specific Models , 2011, ACII.

[6]  Eun-Hyun Lee,et al.  Review of the psychometric evidence of the perceived stress scale. , 2012, Asian nursing research.

[7]  Linda Spear,et al.  Developmental differences in the effects of alcohol and stress on heart rate variability , 2014, Physiology & Behavior.

[8]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Andrea Gaggioli,et al.  Positive technology: a free mobile platform for the self-management of psychological stress. , 2014, Studies in health technology and informatics.

[10]  Rossana Castaldo,et al.  Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis , 2015, Biomed. Signal Process. Control..

[11]  Michael Lyvers,et al.  Cognitive trait anxiety, situational stress, and mental effort predict shifting efficiency: Implications for attentional control theory. , 2015, Emotion.

[12]  Sophia Moses,et al.  Remote stress detection using a visible spectrum camera , 2015, Commercial + Scientific Sensing and Imaging.

[13]  Yannick Benezeth,et al.  Remote photoplethysmography based on implicit living skin tissue segmentation , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[14]  Elena Smets,et al.  Into the Wild: The Challenges of Physiological Stress Detection in Laboratory and Ambulatory Settings , 2019, IEEE Journal of Biomedical and Health Informatics.