Workload management through glanceable feedback: The role of heart rate variability

The active monitoring of workload levels has been found to significantly reduce work-related stress. Heart rate and heart rate variability (HRV) measurements via photoplethysmography (PPG) sensors have shown a strong potential to accurately describe daily workload levels. However, due its complexity, HRV is commonly misunderstood and the associated measurements are rarely incorporated for workload monitoring in novel technological devices such as smartwatches and activity trackers. In this paper we explore the potential of consumer-grade smartwatches, equipped with PPG sensors, to assist in the active monitoring of workload during work hours. We develop a prototype that employs the SDNN index, a powerful HRV marker for cardiac resilience to differentiate between high and low workload levels along the work day, and presents feedback in glanceable form, by highlighting workload levels and physical activity over the past hour in 5-minutes blocks at the periphery of the smartwatch. A field study with 9 participants and 3 variations of our prototype attempts to quantify the impact of the HRV feedback over subjective and objective workload as well as users' engagement with the smartwatch. Results showed workload levels as inferred from the PPG sensor to positively correlate with self-reported workload and HRV feedback to result to lower levels of workload as compared to a conventional activity tracker. Moreover, users engaged more frequently with the smartwatch when HRV feedback was presented, than when only physical activity feedback was provided. The results suggest that HRV as inferred from PPG sensors in wearables can effectively be used to monitor workload levels during work hours.

[1]  K. Ball,et al.  Associations between psychological stress, eating, physical activity, sedentary behaviours and body weight among women: a longitudinal study , 2013, BMC Public Health.

[2]  Jun Hu,et al.  Design and Evaluation of an Ambient Lighting Interface of HRV Biofeedback System in Home Setting , 2014, UCAmI.

[3]  Wallace Jackson.  Introduction to Android Watch Faces Design: Considerations and Concepts , 2015 .

[4]  Abdulmotaleb El-Saddik,et al.  U-biofeedback: a multimedia-based reference model for ubiquitous biofeedback systems , 2013, Multimedia Tools and Applications.

[5]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[6]  Toshiyo Tamura,et al.  Wearable Photoplethysmographic Sensors—Past and Present , 2014 .

[7]  W. Zareba,et al.  Heart rate variability. , 2013, Handbook of clinical neurology.

[8]  F. Shaffer,et al.  A healthy heart is not a metronome: an integrative review of the heart's anatomy and heart rate variability , 2014, Front. Psychol..

[9]  Sean A. Munson,et al.  Exploring the design space of glanceable feedback for physical activity trackers , 2016, UbiComp.

[10]  J. Vagedes,et al.  How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. , 2013, International journal of cardiology.

[11]  John D Rugh,et al.  Biofeedback: Studies In Clinical Efficacy , 2013 .

[12]  Alkinoos Athanasiou,et al.  Development and User Assessment of a Body-Machine Interface for a Hybrid-Controlled 6-Degree of Freedom Robotic Arm (MERCURY) , 2014 .

[13]  Abdulmotaleb El-Saddik,et al.  Ubiquitous Biofeedback Serious Game for Stress Management , 2016, IEEE Access.

[14]  Gerhard Tröster,et al.  Monitoring of mental workload levels during an everyday life office-work scenario , 2013, Personal and Ubiquitous Computing.

[15]  John Allen.  Photoplethysmography and its application in clinical physiological measurement , 2007, Physiological measurement.

[16]  Chen Liu,et al.  A Theoretical Model of Mental Workload in Pilots Based on Multiple Experimental Measurements , 2014, HCI.

[17]  Adam W. Hoover,et al.  Real-time detection of workload changes using heart rate variability , 2012, Biomed. Signal Process. Control..

[18]  Rollin McCraty,et al.  Heart rate variability biofeedback, executive functioning and chronic brain injury , 2013, Brain injury.

[19]  Andoni Beristain,et al.  Challenges in Wearable Devices Based Pervasive Wellbeing Monitoring , 2015, 2015 International Conference on Identification, Information, and Knowledge in the Internet of Things (IIKI).

[20]  Yongqiang Lyu,et al.  Measuring Photoplethysmogram-Based Stress-Induced Vascular Response Index to Assess Cognitive Load and Stress , 2015, CHI.

[21]  Roberto G Lucchini,et al.  European Approaches to Work-Related Stress: A Critical Review on Risk Evaluation , 2012, Safety and health at work.

[22]  Julia Frankfurter,et al.  Mental Workload Its Theory And Measurement , 2016 .

[23]  Alan J. Dix,et al.  Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me (ACE) , 2005, DiGRA Conference.

[24]  David W. McDonald,et al.  Flowers or a robot army?: encouraging awareness & activity with personal, mobile displays , 2008, UbiComp.

[25]  K. Chon,et al.  Can Photoplethysmography Variability Serve as an Alternative Approach to Obtain Heart Rate Variability Information? , 2008, Journal of Clinical Monitoring and Computing.

[26]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[27]  James Dunbar,et al.  Waste the waist: a pilot randomised controlled trial of a primary care based intervention to support lifestyle change in people with high cardiovascular risk , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[28]  M. Hagströmer,et al.  The International Physical Activity Questionnaire (IPAQ): a study of concurrent and construct validity , 2006, Public Health Nutrition.

[29]  Yang Wang,et al.  Multimodal behavior and interaction as indicators of cognitive load , 2012, TIIS.

[30]  Joel Goh,et al.  The Relationship Between Workplace Stressors and Mortality and Health Costs in the United States , 2016, Manag. Sci..

[31]  J. Kearney,et al.  Stages of change towards physical activity in a nationally representative sample in the European Union , 1999, Public Health Nutrition.

[32]  Mao-Jiun J. Wang,et al.  Effective Indices for Monitoring Mental Workload While Performing Multiple Tasks , 2015, Perceptual and motor skills.

[33]  L. Tetrick,et al.  Research methods in occupational health psychology : measurement, design, and data analysis , 2012 .

[34]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[35]  Barry A. T. Brown,et al.  Smartwatch in vivo , 2016, CHI.

[36]  Seungwoo Kang,et al.  Exploring current practices for battery use and management of smartwatches , 2015, SEMWEB.

[37]  Piotr Cysewski,et al.  Effects of Heart Rate Variability Biofeedback on EEG Alpha Asymmetry and Anxiety Symptoms in Male Athletes: A Pilot Study , 2016, Applied psychophysiology and biofeedback.

[38]  Joseph S. Dumas,et al.  Comparison of three one-question, post-task usability questionnaires , 2009, CHI.

[39]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[40]  Evangelos Karapanos,et al.  How do we engage with activity trackers?: a longitudinal study of Habito , 2015, UbiComp.