Workload profiles: A continuous measure of mental workload

Abstract The required frequency and disruptive method in which existing subjective measures of mental workload are collected make them infeasible for many types of task allocation decisions. In this paper, we present a method for continually estimating workload without interrupting the operator. When expressed as a time-series, this continual workload assessment becomes a workload profile which can serve purposes before, during, and after task execution. We identify five thrusts areas for using workload profiles which cannot be accomplished using existing workload measures. These thrust areas include characterization of workload over time; identifying the impacts of task management strategy on mission accomplishment; evaluating potential effects of systems design options—including automation—on task performance; informing manpower allocation decisions; and enhancing physiological computing and neuroergonomic research.

[1]  Laura Pickup,et al.  The Integrated Workload Scale (IWS): a new self-report tool to assess railway signaller workload. , 2005, Applied ergonomics.

[2]  G. Wilson.  Applied use of cardiac and respiration measures: Practical considerations and precautions , 1992, Biological Psychology.

[3]  Glenn F. Wilson,et al.  Putting the Brain to Work: Neuroergonomics Past, Present, and Future , 2008, Hum. Factors.

[4]  Christopher Jason Best.  Modeling Dual-Task Concurrency and Effort in QN-ACTR and IMPRINT. , 2013 .

[5]  Stephen H. Fairclough,et al.  A research agenda for physiological computing , 2004, Interact. Comput..

[6]  Grant Taylor,et al.  Comparison of Multiple Physiological Sensors to Classify Operator State in Adaptive Automation Systems , 2010 .

[7]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[8]  Regina A. Pomranky.  Human Robotics Interaction Army Technology Objective Raven Small Unmanned Aerial Vehicle Task Analysis and Modeling , 2006 .

[9]  G. Wilson,et al.  Cognitive task classification based upon topographic EEG data , 1995, Biological Psychology.

[10]  Lucia Salvi.  Development of Improved Performance Research Integration Tool (IMPRINT) Performance Degradation Factors for the Air Warrior Program , 2001 .

[11]  Diane K Mitchell.  Advanced Improved Performance Research Integration Tool (IMPRINT) Vetronics Technology Test Bed Model Development , 2003 .

[12]  K. Teigen.  Yerkes-Dodson: A Law for all Seasons , 1994 .

[13]  David B. Boles,et al.  The Multiple Resources Questionnaire (MRQ) , 2001 .

[14]  J H McCracken,et al.  Analyses of Selected LHX Mission Functions: Implications for Operator Workload and System Automation Goals , 1984 .

[15]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[16]  Glenn F. Wilson,et al.  Performance and Psychophysiological Measures of Fatigue Effects on Aviation Related Tasks of Varying Difficulty , 2007 .

[17]  Laurel Allender,et al.  Verification, Validation, and Accreditation of a Soldier-System Modeling Tool , 1995 .

[18]  Kristin M. Schweitzer,et al.  IMPRINT Analysis of an Unmanned Air System Geospatial Information Process , 2008 .

[19]  Christopher D. Wickens,et al.  Using Interference Models to Predict Performance in a Multiple-Task UAV Environment - 2 UAVs , 2003 .

[20]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[21]  Rebecca Brown,et al.  Evaluation of Subjective and EEG-Based Measures of Mental Workload , 2013, HCI.

[22]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[23]  Wolfram Boucsein,et al.  Combining electrodermal responses and cardiovascular measures for probing adaptive automation during simulated flight. , 2009, Applied ergonomics.

[24]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[25]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[26]  Regina A. Pomranky,et al.  Determination of Mental Workload During Operation of Multiple Unmanned Systems , 2007 .

[27]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[28]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[29]  Michael F. Schneider,et al.  Architecture Based Workload Analysis of UAS Multi-Aircraft Control: Implications of Implementation on MQ-1B Predator , 2011 .

[30]  Joshua S. Kennedy.  A Human-Automation Interface Model to Guide Automation Design of System Functions: A Way to Achieve Manning Goals in New Systems , 2005 .

[31]  R. Goonetilleke,et al.  Simplified subjective workload assessment technique , 2001, Ergonomics.

[32]  M. A. Recarte,et al.  Mental Workload and Visual Impairment: Differences between Pupil, Blink, and Subjective Rating , 2008, The Spanish Journal of Psychology.

[33]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[34]  Kristian Lukander,et al.  Estimating Brain Load from the EEG , 2009, TheScientificWorldJournal.

[35]  M. Just,et al.  Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work , 2003 .

[36]  Hyung-Shik Jung,et al.  Establishment of overall workload assessment technique for various tasks and workplaces , 2001 .

[37]  Joel S. Warm,et al.  Cerebral Hemodynamics and Vigilance , 2006, Neuroergonomics.

[38]  David B. Kaber,et al.  Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload , 2000 .

[39]  Dietrich Manzey,et al.  Impact of automated decision aids on performance, operator behaviour and workload in a simulated supervisory control task , 2009, Ergonomics.

[40]  Brett J. Borghetti,et al.  Improving Model Cross-Applicability for Operator Workload Estimation , 2015 .

[41]  Bruce P. Hunn,et al.  A Shadow Unmanned Aerial Vehicle (UAV) Improved Performance Research Integration Tool (IMPRINT) Model Supporting Future Combat Systems , 2006 .

[42]  Michael E. Miller,et al.  Predictive mental workload modeling for semiautonomous system design: Implications for systems of systems , 2012, Syst. Eng..

[43]  Travis J Pond.  Discrete Event Simulation of Distributed Team Communication , 2012 .

[44]  A. H. Roscoe,et al.  A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use , 1990 .

[45]  Régis Mollard,et al.  Point-of-Gaze Evaluation in Simulated ATC , 2000 .

[46]  Brett J. Borghetti,et al.  Objective-Analytical Measures of Workload - the Third Pillar of Workload Triangulation? , 2015, HCI.

[47]  Chris Piaszczyk,et al.  Model Based Systems Engineering with Department of Defense Architectural Framework , 2011, Syst. Eng..

[48]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[49]  Diane Kuhl. Mitchell,et al.  Workload Analysis of the Crew of the Abrams V2 SEP: Phase I Baseline IMPRINT Model , 2009 .

[50]  Caroline Dussault,et al.  EEG and ECG changes during selected flight sequences. , 2004, Aviation, space, and environmental medicine.

[51]  Josephine Quinn Wojciechowski,et al.  Validation of a Task Network Human Performance Model of Driving , 2007 .

[52]  P. Tsang,et al.  Diagnosticity and multidimensional subjective workload ratings. , 1996, Ergonomics.

[53]  Michela Terenzi,et al.  Using the Distribution of Eye Fixations to Assess Pilots' Mental Workload , 2006 .

[54]  Theodore B. Aldrich,et al.  Task Analysis of the UH-60 Mission and Decision Rules for Developing a UH-60 Workload Prediction Model. Volume 1. Summary Report , 1989 .

[55]  Charneta Samms,et al.  Trade Study: A Two- Versus Three-Soldier Crew for the Mounted Combat System (MCS) and Other Future Combat System Platforms , 2003 .

[56]  Michael E. Smith,et al.  Neurophysiological measures of cognitive workload during human-computer interaction , 2003 .