Effects of Workload and Workload Transitions on Attention Allocation in a Dual-Task Environment: Evidence From Eye Tracking Metrics

High mental workload, in addition to changes in workload, can negatively affect operators, but it is not clear how sudden versus gradual workload transitions influence performance and visual attention allocation. This knowledge is important as sudden shifts in workload are common in multitasking domains. The objective of this study was to investigate, using performance and eye tracking metrics, how constant versus variable levels of workload affect operators in the context of a dual-task paradigm. An unmanned aerial vehicle command and control simulation varied task load between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance on a primary and secondary task and several eye tracking measures were calculated. There was no significant difference between sudden and gradual workload transitions in terms of performance or attention allocation overall; however, both sudden and gradual workload transitions changed participants’ strategy in dealing with the primary and secondary task as compared to low/high workload. Also, eye tracking metrics that are not frequently used, such as transition rate and stationary entropy, provided more insight into performance differences. These metrics can potentially be used to better understand operators’ strategies and could form the basis of an adaptive display.

[1]  Jo-Anne LeFevre,et al.  Prospective memory failures in aviation: effects of cue salience, workload, and individual differences. , 2015, Aerospace medicine and human performance.

[2]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[3]  C. Wickens,et al.  Workload transition: Implications for individual and team performance. , 1993 .

[4]  J. Enns,et al.  Paying attention behind the wheel: a framework for studying the role of attention in driving , 2004 .

[5]  M L Matthews.  The Influence of Visual Workload History on Visual Performance , 1986, Human factors.

[6]  William B. Rouse,et al.  Modeling the dynamics of mental workload and human performance in complex systems , 1993, IEEE Trans. Syst. Man Cybern..

[7]  Sheue-Ling Hwang,et al.  Predicting Work Performance in Nuclear Power Plants , 2008 .

[8]  Frans A. J. Verstraten,et al.  Saccades Toward the Target Are Planned as Sequences Rather Than as Single Steps , 2013, Psychological science.

[9]  Melissa Patricia Coral.  Analyzing Cognitive Workload through Eye-Related Measurements: A Meta-Analysis , 2016 .

[10]  David Whitney,et al.  Facilitating recognition of crowded faces with presaccadic attention , 2014, Front. Hum. Neurosci..

[11]  W H Teichner,et al.  The Detection of a Simple Visual Signal as a Function of Time of Watch , 1974, Human factors.

[12]  Robert A Goldberg,et al.  Memory overload or expectancy effect? 'Hysteresis' revisited. , 1980, Ergonomics.

[13]  Gregory L Feitshans,et al.  Vigilant Spirit Control Station (VSCS) "The Face of COUNTER" , 2008 .

[14]  José J. Cañas,et al.  Evaluating mental workload while interacting with computer-generated artificial environments , 2013, Entertain. Comput..

[15]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[16]  Christopher D. Wickens,et al.  Mission Control of Multiple Unmanned Aerial Vehicles: A Workload Analysis , 2005, Hum. Factors.

[17]  Mariea C. Dunn,et al.  Behavioural implications of alarm mistrust as a function of task workload , 2000, Ergonomics.

[18]  Nadine B. Sarter,et al.  Clutter in Electronic Medical Records , 2015, Hum. Factors.

[19]  R. Rosenholtz,et al.  More than the Useful Field: Considering peripheral vision in driving. , 2017, Applied ergonomics.

[20]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[21]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[22]  Luz-Eugenia Cox-Fuenzalida,et al.  Effect of Workload History on Task Performance , 2007, Hum. Factors.

[23]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[24]  Peter A. Hancock,et al.  The Effect of Prior Task Loading on Mental Workload , 2011, Hum. Factors.

[25]  Daniel J. Barber,et al.  The Psychometrics of Mental Workload , 2015, Hum. Factors.

[26]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[27]  E M Rantanen,et al.  The effect of mental workload on the visual field size and shape. , 1999, Ergonomics.

[28]  M. Scerbo,et al.  Changes in stress and subjective workload over time following a workload transition , 2015 .

[29]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[30]  Michela Terenzi,et al.  A Random Glance at the Flight Deck: Pilots' Scanning Strategies and the Real-Time Assessment of Mental Workload , 2007 .

[31]  R. Rosenholtz.  Capabilities and Limitations of Peripheral Vision. , 2016, Annual review of vision science.

[32]  Nadine Sarter,et al.  Using Eye Tracking to Detect the Effects of Clutter on Visual Search in Real Time , 2017, IEEE Transactions on Human-Machine Systems.

[33]  Cheryl K. Beeler,et al.  Workload history effects: A comparison of sudden increases and decreases on performance , 2006 .

[34]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[35]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[36]  B. Cain.  A Review of the Mental Workload Literature , 2007 .

[37]  Christopher D. Wickens,et al.  Automation Reliability in Unmanned Aerial Vehicle Control: A Reliance-Compliance Model of Automation Dependence in High Workload , 2006, Hum. Factors.

[38]  L. Mulder,et al.  Please Scroll down for Article Ergonomics Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight , 2022 .

[39]  Joseph T. Coyne,et al.  Assessing Workload with Low Cost Eye Tracking During a Supervisory Control Task , 2017, HCI.

[40]  Bryan Reimer,et al.  Classifying driver workload using physiological and driving performance data: two field studies , 2014, CHI.

[41]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[42]  D. Potter,et al.  Does preoccupation impair hazard perception? A simultaneous EEG and Eye Tracking study , 2013 .

[43]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[44]  Mark S. Young,et al.  Malleable Attentional Resources Theory: A New Explanation for the Effects of Mental Underload on Performance , 2002, Hum. Factors.

[45]  Andrew T. Duchowski,et al.  Entropy-based statistical analysis of eye movement transitions , 2014, ETRA.

[46]  Christopher D. Wickens,et al.  ATTENTION TO SAFETY AND THE PSYCHOLOGY OF SURPRISE , 2001 .

[47]  G Schneider,et al.  Eye tracking for assessment of workload: a pilot study in an anaesthesia simulator environment. , 2011, British journal of anaesthesia.

[48]  Ioan Opris,et al.  Neural correlates of fast pupil dilation in nonhuman primates: Relation to behavioral performance and cognitive workload , 2010, Behavioural Brain Research.

[49]  Nadine B. Sarter,et al.  Display Clutter , 2015, Hum. Factors.

[50]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[51]  R. Cumming.  Human information processing under varying task demand. , 1973, Ergonomics.

[52]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[53]  Andreas Dunser,et al.  Combining EEG with Pupillometry to Improve Cognitive Workload Detection , 2015, Computer.

[54]  J. Veltman,et al.  Physiological indices of workload in a simulated flight task , 1996, Biological Psychology.

[55]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[56]  Katharina Rifai,et al.  Sampling rate influences saccade detection in mobile eye tracking of a reading task , 2017, Journal of eye movement research.

[57]  J. Wolfe,et al.  Five factors that guide attention in visual search , 2017, Nature Human Behaviour.

[58]  Adam W. Hoover,et al.  Real-time detection of workload changes using heart rate variability , 2012, Biomed. Signal Process. Control..

[59]  James R. Bergen,et al.  Parallel versus serial processing in rapid pattern discrimination , 1983, Nature.

[60]  Mary L. Cummings,et al.  Investigating Mental Workload Changes in a Long Duration Supervisory Control Task , 2015, Interact. Comput..

[61]  Florian Jentsch,et al.  Surprise and Unexpectedness in Flying: Database Reviews and Analyses , 2004 .

[62]  Joseph T. Coyne,et al.  Using machine learning and real-time workload assessment in a high-fidelity UAV simulation environment , 2016, SPIE Defense + Security.

[63]  Peter Chapman,et al.  Mental workload is reflected in driver behaviour, physiology, eye movements and prefrontal cortex activation. , 2018, Applied ergonomics.

[64]  R. M. Taylor,et al.  Situational Awareness Rating Technique (Sart): The Development of a Tool for Aircrew Systems Design , 2017 .

[65]  P A Hancock,et al.  Influence of task demand characteristics on workload and performance. , 1995, The International journal of aviation psychology.