Measuring mental workload using physiological measures: A systematic review.

Technological advances have led to physiological measurement being increasingly used to measure and predict operator states. Mental workload (MWL) in particular has been characterised using a variety of physiological sensor data. This systematic review contributes a synthesis of the literature summarising key findings to assist practitioners to select measures for use in evaluation of MWL. We also describe limitations of the methods to assist selection when being deployed in applied or laboratory settings. We detail fifty-eight peer reviewed journal articles which present original data using physiological measures to include electrocardiographic, respiratory, dermal, blood pressure and ocular. Electroencephalographic measures have been included if they are presented with another measure to constrain scope. The literature reviewed covers a range of applied and experimental studies across various domains, safety-critical applications being highly represented in the sample of applied literature reviewed. We present a summary of the six measures and provide an evidence base which includes how to deploy each measure, and characteristics that can affect or preclude the use of a measure in research. Measures can be used to discriminate differences in MWL caused by task type, task load, and in some cases task difficulty. Varying ranges of sensitivity to sudden or gradual changes in taskload are also evident across the six measures. We conclude that there is no single measure that clearly discriminates mental workload but there is a growing empirical basis with which to inform both science and practice.

[1]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[2]  Herbert A. Colle,et al.  Context Effects in Subjective Mental Workload Ratings , 1998, Hum. Factors.

[3]  F. Freeman,et al.  A Closed-Loop System for Examining Psychophysiological Measures for Adaptive Task Allocation , 2000, The International journal of aviation psychology.

[4]  Yanyu Lu,et al.  Physiological Indices of Pilots' Abilities Under Varying Task Demands. , 2016, Aerospace medicine and human performance.

[5]  Peter Nickel,et al.  Sensitivity and Diagnosticity of the 0.1-Hz Component of Heart Rate Variability as an Indicator of Mental Workload , 2003, Hum. Factors.

[6]  Bin Wu,et al.  Using Physiological Parameters to Evaluate Operator's Workload in Manual Controlled Rendezvous and Docking (RVD) , 2011, HCI.

[7]  Mark S. Young,et al.  Fundamental examination of mental workload in the rail industry , 2005 .

[8]  Carolyne R Swain,et al.  Electrophysiological, behavioral, and subjective indexes of workload when performing multiple tasks: manipulations of task difficulty and training. , 1999, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  Stephen H. Boutcher,et al.  Cardiovascular response to Stroop: Effect of verbal response and task difficulty , 2006, Biological Psychology.

[10]  S. Miyake Multivariate workload evaluation combining physiological and subjective measures. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Sheue-Ling Hwang,et al.  Predicting Work Performance in Nuclear Power Plants , 2008 .

[12]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[13]  Xiaolu Dong,et al.  Mental workload measurement for emergency operating procedures in digital nuclear power plants , 2013, Ergonomics.

[14]  Tomi Laitinen,et al.  Heart rate and performance during combat missions in a flight simulator. , 2007, Aviation, space, and environmental medicine.

[15]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[16]  Michael E. Miller,et al.  Prediction of Perceived Workload From Task Performance and Heart Rate Measures , 2013 .

[17]  P. Sleight,et al.  Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability. , 2000, Journal of the American College of Cardiology.

[18]  P Kuronen,et al.  Heart rate responses to real and simulated BA Hawk MK 51 flight. , 1997, Aviation, space, and environmental medicine.

[19]  G. Wilson Applied use of cardiac and respiration measures: Practical considerations and precautions , 1992, Biological Psychology.

[20]  Tytus Sosnowski,et al.  Program running versus problem solving: mental task effect on tonic heart rate. , 2004, Psychophysiology.

[21]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[22]  Theodore B. Aldrich,et al.  The Development and Application of Models to Predict Operator Workload During System Design , 1989 .

[23]  L Finsen,et al.  Muscle activity and cardiovascular response during computer-mouse work with and without memory demands , 2001, Ergonomics.

[24]  Elke Vlemincx,et al.  Individual differences in cardiorespiratory measures of mental workload: An investigation of negative affectivity and cognitive avoidant coping in pilot candidates. , 2017, Applied ergonomics.

[25]  Heikki Mansikka,et al.  Fighter pilots' heart rate, heart rate variation and performance during an instrument flight rules proficiency test. , 2016, Applied ergonomics.

[26]  A. H. Roscoe,et al.  A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use , 1990 .

[27]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[28]  C D Wickens,et al.  Assessment of pilot performance and mental workload in rotary wing aircraft. , 1993, Ergonomics.

[29]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[30]  Maarten A. Hogervorst,et al.  Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workload , 2014, Front. Neurosci..

[31]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[32]  G. Robert J. Hockey,et al.  Level of Operator Control and Changes in Heart Rate Variability during Simulated Flight Maintenance , 1995, Hum. Factors.

[33]  Xiaolin Yu,et al.  Effects of mental tasks on the cardiorespiratory synchronization , 2010, Respiratory Physiology & Neurobiology.

[34]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[35]  H. Muir,et al.  A psychophysiological approach to the assessment of work underload. , 1993, Ergonomics.

[36]  M Myrtek,et al.  Physical, mental, emotional, and subjective workload components in train drivers. , 1994, Ergonomics.

[37]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[38]  Glenn F. Wilson,et al.  An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures , 2002 .

[39]  Jim Nixon,et al.  Understanding the human performance envelope using electrophysiological measures from wearable technology , 2017, Cognition, Technology & Work.

[40]  Mao-Jiun J. Wang,et al.  Effective Indices for Monitoring Mental Workload While Performing Multiple Tasks , 2015, Perceptual and motor skills.

[41]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[42]  Aspects of Visual Search Activity Related to Attentional Processes and Skill Development , 1980 .

[43]  D. Brodie,et al.  Effects of Short-Term Psychological Stress on the Time and Frequency Domains of Heart-Rate Variability , 2000, Perceptual and motor skills.

[44]  W. Klimesch EEG-alpha rhythms and memory processes. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[45]  S G Hart,et al.  Inflight application of three pilot workload measurement techniques. , 1987, Aviation, space, and environmental medicine.

[46]  J. A. Veltman,et al.  A Comparative Study of Psychophysiological Reactions During Simulator and Real Flight , 2002 .

[47]  L. Mulder,et al.  Please Scroll down for Article Ergonomics Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight , 2022 .

[48]  Derek W. Johnston,et al.  The relationship between cardiovascular responses in the laboratory and in the field. , 1990, Psychophysiology.

[49]  James C. Christensen,et al.  Coadaptive Aiding and Automation Enhance Operator Performance , 2013, Hum. Factors.

[50]  James F. O'Hanlon,et al.  Heart Rate Variability: A New Index of Driver Alertness/Fatigue , 1972 .

[51]  Joachim Vogt,et al.  The Impact of Workload on Heart Rate and Blood Pressure in En-Route and Tower Air Traffic Control , 2006 .

[52]  Majid Fallahi,et al.  Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study. , 2016, Applied ergonomics.

[53]  J. Dusek,et al.  Impact of Incremental Increases in Cognitive Workload on Physiological Arousal and Performance in Young Adult Drivers , 2009 .

[54]  Richard W. Backs,et al.  Cardiorespiratory Indices of Mental Workload during Simulated Air Traffic Control , 2000 .

[55]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[56]  A. H. Roscoe Assessing pilot workload. Why measure heart rate, HRV and respiration? , 1992, Biological Psychology.

[57]  M. Holland,et al.  Blinking and Mental Load , 1972, Psychological reports.

[58]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[59]  G. Salvendy,et al.  Review and reappraisal of modelling and predicting mental workload in single- and multi-task environments , 2000 .

[60]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[61]  Mickaël Causse,et al.  Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task , 2010, Applied psychophysiology and biofeedback.

[62]  N. Moray Mental workload : its theory and measurement , 1979 .

[63]  S. Tremblay,et al.  Using near infrared spectroscopy and heart rate variability to detect mental overload , 2014, Behavioural Brain Research.

[64]  L C Walrath,et al.  Auditory discrimination and the eyeblink. , 1985, Psychophysiology.

[65]  P. Jorna Spectral analysis of heart rate and psychological state: A review of its validity as a workload index , 1992, Biological Psychology.

[66]  R W Backs,et al.  Metabolic and cardiorespiratory measures of mental effort: the effects of level of difficulty in a working memory task. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[67]  T. Meijman,et al.  Immediate and delayed after-effects of long lasting mentally demanding work , 2000, Biological Psychology.

[68]  S. Fairclough,et al.  Prediction of subjective states from psychophysiology: A multivariate approach , 2006, Biological Psychology.

[69]  S. Miyake,et al.  Physiological responses to workload change. A test/retest examination. , 2009, Applied ergonomics.

[70]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[71]  D. Sanabria,et al.  Heart rate variability and cognitive processing: The autonomic response to task demands , 2016, Biological Psychology.

[72]  Glenn F. Wilson,et al.  Psychological and Psychophysiological Models of Pilot Performance for Systems Development and Mission Evaluation , 2002 .

[73]  P. Lehrer,et al.  Cardiac data increase association between self-report and both expert ratings of task load and task performance in flight simulator tasks: An exploratory study. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[74]  G F Wilson,et al.  Air-to-ground training missions: a psychophysiological workload analysis. , 1993, Ergonomics.

[75]  C. Guézennec,et al.  EEG and ECG changes during simulator operation reflect mental workload and vigilance. , 2005, Aviation, space, and environmental medicine.

[76]  Elke Vlemincx,et al.  Respiratory Changes in Response to Cognitive Load: A Systematic Review , 2016, Neural plasticity.

[77]  Caroline Dussault,et al.  EEG and ECG changes during selected flight sequences. , 2004, Aviation, space, and environmental medicine.

[78]  Andreas Henelius,et al.  Mental workload classification using heart rate metrics , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[79]  Louise Venables,et al.  The influence of task demand and learning on the psychophysiological response. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[80]  Daniel J. Barber,et al.  The Psychometrics of Mental Workload , 2015, Hum. Factors.

[81]  Peter Nickel,et al.  Designing automation for complex work environments under different levels of stress. , 2013, Applied ergonomics.

[82]  M Angelborg-Thanderz,et al.  Information complexity--mental workload and performance in combat aircraft. , 1997, Ergonomics.

[83]  Heikki Mansikka,et al.  Fighter pilots’ heart rate, heart rate variation and performance during instrument approaches , 2016, Ergonomics.

[84]  Wondea Jung,et al.  A study on the validity of a task complexity measure for emergency operating procedures of nuclear power plants - Comparing task complexity scores with two sets of operator response time data obtained under a simulated SGTR , 2008, Reliab. Eng. Syst. Saf..

[85]  Peter A Hancock,et al.  State of science: mental workload in ergonomics , 2015, Ergonomics.

[86]  J. Veltman,et al.  Physiological indices of workload in a simulated flight task , 1996, Biological Psychology.

[87]  C Collet,et al.  Measuring workload with electrodermal activity during common braking actions , 2014, Ergonomics.

[88]  Miriam Reiner,et al.  Estimating mental workload through event-related fluctuations of pupil area during a task in a virtual world. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[89]  Christopher D. Wickens,et al.  Situation Awareness: Review of Mica Endsley's 1995 Articles on Situation Awareness Theory and Measurement , 2008, Hum. Factors.

[90]  Bor-Shong Liu,et al.  Inflight workload assessment: comparison of subjective and physiological measurements. , 2003, Aviation, space, and environmental medicine.

[91]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[92]  Przemyslaw Guzik,et al.  ECG by mobile technologies. , 2016, Journal of electrocardiology.

[93]  Huan Zhang,et al.  Improving pilot mental workload evaluation with combined measures. , 2014, Bio-medical materials and engineering.

[94]  L. Mulder,et al.  A Psychophysiological Approach to Working Conditions , 2000 .

[95]  C. E. Adams,et al.  Environmental and Behavioral Factors That Can Affect Blood Pressure , 1985, The Nurse practitioner.

[96]  R W Backs,et al.  Psychophysiological Measures of Workload during Continuous Manual Performance , 1994, Human factors.

[97]  Michael Falkenstein,et al.  Effects of attention and time-pressure on P300 subcomponents and implications for mental workload research , 1995, Biological Psychology.