Effects of Sensory Modality and Task Duration on Performance, Workload, and Stress in Sustained Attention

The workload and stress associated with a 40-min vigilance task were examined under conditions wherein observers monitored an auditory or a visual display for changes in signal duration. Global workload scores fell in the midrange of the NASA Task Load Index, with scores on the Frustration subscale increasing linearly over time. These effects were unrelated to the sensory modality of signals. However, sensory modality was a significant moderator variable for stress. Observers became more stressed over time as indexed by responses to the Dundee Stress State Questionnaire, with evidence of recovery in the auditory but not the visual condition toward the end of the watch. This result and the finding that signal detection accuracy - although equated for difficulty under alerted conditions - favored the auditory mode, indicate that display modality and time on task should be considered carefully in the design of operations requiring sustained attention in order to enhance performance and reduce stress. Actual or potential applications of this research include domains in which monitoring is a crucial part, such as baggage screening, security operations, medical monitoring, and power plant operations.

[1]  C. Wickens,et al.  Workload transition: Implications for individual and team performance. , 1993 .

[2]  George A. Gescheider,et al.  Psychophysics: The Fundamentals , 1997 .

[3]  Joel S. Warm,et al.  Psychology of Perception , 1957 .

[4]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[5]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[6]  Joel S. Warm,et al.  Cross-modal correlations of the perceived durations of auditory and visual stimuli , 1966 .

[7]  Mark W. Scerbo,et al.  50 Years of Vigilance Research: Where are we now? , 1998 .

[8]  J. L. Hatfield,et al.  Sense mode and coupling in a vigilance task , 1968 .

[9]  Edward M. Hitchcock,et al.  Automation cueing modulates cerebral blood flow and vigilance in a simulated air traffic control task , 2003 .

[10]  W. N. Dember,et al.  Psychophysical Determinants of Stress in Sustained Attention , 1993, Human factors.

[11]  Joel S. Warm,et al.  Optimism, pessimism, and false failure feedback: Effects on vigilance performance , 1999 .

[12]  P. Hancock,et al.  Human Mental Workload , 1988 .

[13]  W. N. Dember,et al.  The Common Cold Impairs Visual Attention, Psychomotor Performance and Task Engagement , 2001 .

[14]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[15]  S. Folkman,et al.  Stress, appraisal, and coping , 1974 .

[16]  A. Vendrik,et al.  CAN A SENSORY SYSTEM BE SPECIFIED BY ITS INTERNAL NOISE? , 1965, The Journal of the Acoustical Society of America.

[17]  R. A. Bailey Designing Experiments and Analyzing Data: a Model Comparison Perspective, 2nd edn , 2005 .

[18]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data , 1992 .

[19]  G. Keppel Design and analysis: A researcher's handbook, 3rd ed. , 1991 .

[20]  Gerald Matthews,et al.  Task-Induced Stress and Individual Differences in Coping , 1998 .

[21]  J. Warm Sustained attention in human performance , 1984 .

[22]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[23]  J. Warm,et al.  Intermodal transfer in temporal discrimination , 1975 .

[24]  D. Damos Multiple-task performance , 2020 .

[25]  T. Münte,et al.  Relation of cerebral blood flow velocity and level of vigilance in humans , 1997, Neuroreport.

[26]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[27]  P. Hancock,et al.  A Dynamic Model of Stress and Sustained Attention , 1989, Human factors.

[28]  H Cook,et al.  The price of freedom. , 1986, The Health service journal.

[29]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[30]  James L. Szalma,et al.  The Vigilance Decrement Reflects Limitations in Effortful Attention, Not Mindlessness , 2003, Hum. Factors.

[31]  G. Matthews,et al.  Task-induced fatigue states and simulated driving performance , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[32]  C. Wickens,et al.  Dissociation of Performance and Subjective Measures of Workload , 1988 .

[33]  Raymond S. Nickerson,et al.  Looking Ahead: Human Factors Challenges in A Changing World , 1992 .

[34]  W. N. Dember,et al.  Vigilance: Taxonomy And Utility , 1987 .

[35]  William N. Dember,et al.  VIGILANCE AND WORKLOAD IN AUTOMATED SYSTEMS. , 1996 .

[36]  Raja Parasuraman,et al.  Varieties of attention , 1984 .

[37]  Joel S. Warm,et al.  The Rate of Gain of Perceived Workload in Sustained Attention , 1993 .

[38]  G. Keppel,et al.  Design and Analysis: A Researcher's Handbook , 1976 .

[39]  Joel S. Warm,et al.  The Effects of Signal Salience and Caffeine on Performance, Workload, and Stress in an Abbreviated Vigilance Task , 2000, Hum. Factors.

[40]  Leonard S. Mark Joel S. Warm,et al.  Ergonomics and Human Factors: Recent Research , 1987 .

[41]  T. Natsoulas What are perceptual reports about? , 1967, Psychological bulletin.

[42]  Piotr Stefan Wandycz,et al.  The Price of Freedom , 1992 .

[43]  Mark S. Young,et al.  A proposed psychological model of driving automation , 2000 .

[44]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[45]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[46]  Joel S. Warm,et al.  The Psychophysics of Vigilance , 1980 .

[47]  J. Bermúdez,et al.  Personality Psychology in Europe , 1997 .

[48]  Gavriel Salvendy,et al.  Handbook of human factors. , 1987 .

[49]  P A Hancock,et al.  Effects of jet engine noise and performance feedback on perceived workload in a monitoring task. , 1995, The International journal of aviation psychology.

[50]  Joel S. Warm,et al.  Effects of Cueing and Knowledge of Results on Workload and Boredom in Sustained Attention , 1999, Hum. Factors.