Viewing the Workload of Vigilance Through the Lenses of the NASA-TLX and the MRQ

Objective: The aim of this study was to compare the effectiveness of a new index of perceived mental workload, the Multiple Resource Questionnaire (MRQ), with the standard measure of workload used in the study of vigilance, the NASA Task Load Index (NASA-TLX). Background: The NASA-TLX has been used extensively to demonstrate that vigilance tasks impose a high level of workload on observers. However, this instrument does not specify the information-processing resources needed for task performance. The MRQ offers a tool to measure the workload associated with vigilance assignments in which such resources can be identified. Method: Two experiments were performed in which factors known to influence task demand were varied. Included were the detection of stimulus presence or absence, detecting critical signals by means of successive-type (absolute judgment) and simultaneous-type (comparative judgment) discriminations, and operating under multitask vs. single-task conditions. Results: The MRQ paralleled the NASA-TLX in showing that vigilance tasks generally induce high levels of workload and that workload scores are greater in detecting stimulus absence than presence and in making successive as compared to simultaneous-type discriminations. Additionally, the MRQ was more effective than the NASA-TLX in reflecting higher workload in the context of multitask than in single-task conditions. The resource profiles obtained with MRQ fit well with the nature of the vigilance tasks employed, testifying to the scale’s content validity. Conclusion: The MRQ may be a meaningful addition to the NASA-TLX for measuring the workload of vigilance assignments. Application: By uncovering knowledge representation associated with different tasks, the MRQ may aid in designing operational vigilance displays.

[1]  M. Kane,et al.  What Mind Wandering Reveals About Executive-Control Abilities and Failures , 2012 .

[2]  M. Scerbo.  What's so boring about vigilance? , 1998 .

[3]  R. Parasuraman.  Memory load and event rate control sensitivity decrements in sustained attention. , 1979, Science.

[4]  D. Kahneman,et al.  Attention and Effort , 1973 .

[5]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[6]  G. Matthews.  Human Performance: Cognition, Stress and Individual Differences , 2000 .

[7]  M. Scerbo.  STRESS, WORKLOAD, AND BOREDOM IN VIGILANCE: A PROBLEM AND AN ANSWER. , 2001 .

[8]  James L. Szalma,et al.  The Measurement of Perceptual Resources and Workload , 2015 .

[9]  Andrew P. Smith,et al.  Handbook of human performance , 1992 .

[10]  David B. Boles,et al.  Validity of the Multiple Resources Questionnaire (MRQ) , 2001 .

[11]  James L. Szalma,et al.  Effects of Sensory Modality and Task Duration on Performance, Workload, and Stress in Sustained Attention , 2004, Hum. Factors.

[12]  David F. Feldon,et al.  Cognitive task analysis , 2009 .

[13]  I. Robertson,et al.  `Oops!': Performance correlates of everyday attentional failures in traumatic brain injured and normal subjects , 1997, Neuropsychologia.

[14]  Joel S. Warm,et al.  Viewing psychology as a whole : the integrative science of William N. Dember , 1998 .

[15]  S. Eickhoff,et al.  Mental Fatigue Modulates Dynamic Adaptation to Perceptual Demand in Speeded Detection , 2011, PloS one.

[16]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[17]  David B. Boles,et al.  Predicting Dual-Task Performance With the Multiple Resources Questionnaire (MRQ) , 2007, Hum. Factors.

[18]  A. Coenen,et al.  Mental effort causes vigilance decrease due to resource depletion. , 2004, Acta psychologica.

[19]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[20]  S. Urbina,et al.  Psychological testing, 7th ed. , 1997 .

[21]  Joel S. Warm,et al.  Cerebral Hemodynamics and Vigilance Performance , 2009 .

[22]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[23]  W. T. Nelson,et al.  Vigilance , 2013, Royal Society of Health journal.

[24]  N. Mackworth.  In Search of Vigilance , 2013 .

[25]  Joel S. Warm,et al.  Measuring Vigilance Abilities to Enhance Combat Identification Performance , 2009 .

[26]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[27]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[28]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[29]  M. Kane,et al.  Does mind wandering reflect executive function or executive failure? Comment on Smallwood and Schooler (2006) and Watkins (2008). , 2010, Psychological bulletin.

[30]  Raymond S. Nickerson,et al.  Looking Ahead: Human Factors Challenges in A Changing World , 1992 .

[31]  David B. Boles,et al.  Bidirectional Resource Training of Simple and Complex Tasks , 2012 .

[32]  Robert W Proctor,et al.  Cumulative knowledge and progress in human factors. , 2010, Annual review of psychology.

[33]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[34]  Todd D. Hollander,et al.  Signal regularity and the mindlessness model of vigilance. , 2005, British journal of psychology.

[35]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[36]  Gerald Matthews,et al.  Mental workload and stress perceived by novice operators in the laparoscopic and robotic minimally invasive surgical interfaces. , 2012, Journal of endourology.

[37]  Joel S. Warm,et al.  Vigilance and Signal Detection Theory: An Empirical Evaluation of Five Measures of Response Bias , 1997, Hum. Factors.

[38]  David A. Bridwell,et al.  Interactions between endogenous and exogenous attention during vigilance , 2009, Attention, perception & psychophysics.

[39]  Joel S. Warm,et al.  Perceived Mental Workload in an Endocopic Surgery Simulator , 2005 .

[40]  P. Quinlan.  Visual feature integration theory: past, present, and future. , 2003, Psychological bulletin.

[41]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996, Hum. Factors.

[42]  Raja Parasuraman,et al.  The role of memory representation in the vigilance decrement , 2004, Psychonomic bulletin & review.

[43]  Dudley G. Letbetter.  A Handbook of Human Performance , 1982 .

[44]  Mark W. Wiggins,et al.  Vigilance decrement during a simulated general aviation flight , 2011 .

[45]  T. Natsoulas.  What are perceptual reports about? , 1967, Psychological bulletin.

[46]  W. N. Dember,et al.  Sensory Determinants of Workload and Stress in Sustained Attention , 1999 .

[47]  Judi E. See,et al.  Meta-analysis of the sensitivity decrement in vigilance. , 1995 .

[48]  Joel S. Warm,et al.  The Psychophysics of Vigilance , 1980 .

[49]  J. C. Ballard.  Computerized assessment of sustained attention: a review of factors affecting vigilance performance. , 1996, Journal of clinical and experimental neuropsychology.

[50]  W Brent Seales,et al.  Hands-free administration of subjective workload scales: acceptability in a surgical training environment. , 2010, Applied ergonomics.

[51]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[52]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[53]  Robert P Herz,et al.  Human Factors Issues in Combat Identification , 2012 .

[54]  Ludwig Weber,et al.  EUROPEAN ORGANIZATION FOR THE SAFETY OF AIR NAVIGATION (EUROCONTROL) , 1983 .

[55]  N. Tallent.  Psychological testing. , 1960, The American journal of nursing.

[56]  William N. Dember,et al.  VIGILANCE AND WORKLOAD IN AUTOMATED SYSTEMS. , 1996 .

[57]  P. Hancock,et al.  In search of vigilance: the problem of iatrogenically created psychological phenomena. , 2013, The American psychologist.

[58]  Joel S. Warm,et al.  Feature Presence/Absence Modifies the Event Rate Effect and Cerebral Hemovelocity in Vigilance Performance , 2004 .

[59]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[60]  D B Boles,et al.  A simultaneous task comparison of differentiated and undifferentiated hemispheric resource theories. , 1998, Journal of experimental psychology. Human perception and performance.

[61]  W. N. Dember,et al.  Vigilance: Taxonomy And Utility , 1987 .

[62]  W. N. Dember,et al.  Tests of vigilance taxonomy. , 1998 .