Remote assessment of the heart rate variability to detect mental stress

In the present paper, we introduce a new framework for detecting workload changes using video frames obtained from a low-cost webcam. The measurements are performed on human faces and the proposed algorithms were developed to be motion-tolerant. An interactive Stroop color word test is employed to induce stress on a set of twelve participants. We record the skin conductance and compare these responses to the stress curve assessed by a webcam-derived heart rate variability analysis. The results offer further support for the applicability of stress detection by remote and low-cost means, providing an alternative to conventional contact techniques.

[1]  Winslow Burleson,et al.  ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework , 2011, 2011 Ninth Working IEEE/IFIP Conference on Software Architecture.

[2]  S. Sezer,et al.  Signal processing methods for non-contact cardiac detection using Doppler radar , 2010, 2010 IEEE Workshop On Signal Processing Systems.

[3]  Albert A. Rizzo,et al.  VR PTSD Exposure Therapy Results with Active Duty OIF/OEF Combatants , 2009, MMVR.

[4]  A. Garde,et al.  Effects of mental and physical demands on heart rate variability during computer work , 2002, European Journal of Applied Physiology.

[5]  B. Horecker THE ABSORPTION SPECTRA OF HEMOGLOBIN AND ITS DERIVATIVES IN THE VISIBLE AND NEAR INFRA-RED REGIONS , 1943 .

[6]  R. Mccraty,et al.  Cardiac coherence: a new, noninvasive measure of autonomic nervous system order. , 1996, Alternative therapies in health and medicine.

[7]  Steve B. Jiang,et al.  Doppler radar respiration measurement for gated lung cancer radiotherapy , 2011, 2011 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems.

[8]  Adam W. Hoover,et al.  Real-time detection of workload changes using heart rate variability , 2012, Biomed. Signal Process. Control..

[9]  Branimir Dropuljic,et al.  Real-Time Emotional State Estimator for Adaptive Virtual Reality Stimulation , 2009, HCI.

[10]  Armando Barreto,et al.  Stress Recognition Using Non-invasive Technology , 2006, FLAIRS.

[11]  Branimir Dropuljic,et al.  Physiology-Driven Adaptive Virtual Reality Stimulation for Prevention and Treatment of Stress Related Disorders , 2010, Cyberpsychology Behav. Soc. Netw..

[12]  Marc Garbey,et al.  Interacting with human physiology , 2007, Comput. Vis. Image Underst..

[13]  Roy Kalawsky,et al.  Noncontact imaging photoplethysmography to effectively access pulse rate variability , 2012, Journal of biomedical optics.

[14]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[15]  M Murugappan,et al.  Physiological signals based human emotion Recognition: a review , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[16]  B. Appelhans,et al.  Heart Rate Variability as an Index of Regulated Emotional Responding , 2006 .

[17]  R. B. Knapp,et al.  Physiological signals and their use in augmenting emotion recognition for human-machine interaction , 2011 .

[18]  Karoly Hercegfi,et al.  Heart Rate Variability Monitoring during Human-Computer Interaction , 2011 .