Monitoring of mental workload levels during an everyday life office-work scenario

Personal and ubiquitous healthcare applications offer new opportunities to prevent long-term health damage due to increased mental workload by continuously monitoring physiological signs related to prolonged high workload and providing just-in-time feedback. In order to achieve a quantification of mental load, different load levels that occur during a workday have to be discriminated. In this work, we present how mental workload levels in everyday life scenarios can be discriminated with data from a mobile ECG logger by incorporating individual calibration measures. We present an experiment design to induce three different levels of mental workload in calibration sessions and to monitor mental workload levels in everyday life scenarios of seven healthy male subjects. Besides the recording of ECG data, we collect subjective ratings of the perceived workload with the NASA Task Load Index (TLX), whereas objective measures are assessed by collecting salivary cortisol. According to the subjective ratings, we show that all participants perceived the induced load levels as intended from the experiment design. The heart rate variability (HRV) features under investigation can be classified into two distinct groups. Features in the first group, representing markers associated with parasympathetic nervous system activity, show a decrease in their values with increased workload. Features in the second group, representing markers associated with sympathetic nervous system activity or predominance, show an increase in their values with increased workload. We employ multiple regression analysis to model the relationship between relevant HRV features and the subjective ratings of NASA-TLX in order to predict the mental workload levels during office-work. The resulting predictions were correct for six out of the seven subjects. In addition, we compare the performance of three classification methods to identify the mental workload level during office-work. The best results were obtained with linear discriminant analysis (LDA) that yielded a correct classification for six out of the seven subjects. The k-nearest neighbor algorithm (k-NN) and the support vector machine (SVM) resulted in a correct classification of the mental workload level during office-work for five out of the seven subjects.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[3]  Graham Wilson,et al.  Psychophysiological assessment of workload in multi-task environments , 2020 .

[4]  C. Kirschbaum,et al.  Synthesis of a cortisol-biotin conjugate and evaluation as a tracer in an immunoassay for salivary cortisol measurement , 1992, The Journal of Steroid Biochemistry and Molecular Biology.

[5]  M Kumashiro,et al.  Power Spectral Analysis of Heart Rate Variability in Healthy Young Women During the Normal Menstrual Cycle , 1995, Psychosomatic medicine.

[6]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[7]  E. Poutsma,et al.  EUROPEAN FOUNDATION for the Improvement of Living and Working Conditions , 1999 .

[8]  B. Kudielka,et al.  Impact of gender, menstrual cycle phase, and oral contraceptives on the activity of the hypothalamus-pituitary-adrenal axis. , 1999, Psychosomatic medicine.

[9]  Glenn F. Wilson,et al.  An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures , 2002 .

[10]  Gari D. Clifford,et al.  Signal processing methods for heart rate variability analysis , 2002 .

[11]  S. Dickerson,et al.  Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. , 2004, Psychological bulletin.

[12]  S. Miyake,et al.  Recovery patterns in the physiological responses of the autonomic nervous system induced by mental workload , 2007, SICE Annual Conference 2007.

[13]  Desok Kim,et al.  Detection of subjects with higher self-reporting stress scores using heart rate variability patterns during the day , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Susanne M. Jaeggi,et al.  Improving fluid intelligence with training on working memory: a meta-analysis , 2008, Psychonomic Bulletin & Review.

[15]  Desok Kim,et al.  Decreased long term variations of heart rate variability in subjects with higher self reporting stress scores , 2008, 2008 Second International Conference on Pervasive Computing Technologies for Healthcare.

[16]  Alois Ferscha,et al.  Heart on the road: HRV analysis for monitoring a driver's affective state , 2009, AutomotiveUI.

[17]  Andreas Henelius,et al.  Mental workload classification using heart rate metrics , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Margaret E. Morris,et al.  Mobile Heart Health: Project Highlight , 2009, IEEE Pervasive Computing.

[19]  Karin Sanders,et al.  Emotional exhaustion and mental health problems among employees doing “people work”: the impact of job demands, job resources and family-to-work conflict , 2009, International archives of occupational and environmental health.

[20]  Gerhard Tröster,et al.  What Does Your Chair Know About Your Stress Level? , 2010, IEEE Transactions on Information Technology in Biomedicine.

[21]  Gerhard Tröster,et al.  Monitoring of mental workload levels , 2010 .

[22]  B. Arnrich,et al.  Towards Continuous Monitoring of Mental Workload , 2010 .

[23]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[24]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[25]  Ulrike Ehlert,et al.  Association between Cold Face Test-induced vagal inhibition and cortisol response to acute stress. , 2011, Psychophysiology.