Vigilance on the move: video game-based measurement of sustained attention

Vigilance represents the capacity to sustain attention to any environmental source of information over prolonged periods on watch. Most stimuli used in vigilance research over the previous six decades have been relatively simple and often purport to represent important aspects of detection and discrimination tasks in real-world settings. Such displays are most frequently composed of single stimulus presentations in discrete trials against a uniform, often uncluttered background. The present experiment establishes a dynamic, first-person perspective vigilance task in motion using a video-game environment. ‘Vigilance on the move’ is thus a new paradigm for the study of sustained attention. We conclude that the stress of vigilance extends to the new paradigm, but whether the performance decrement emerges depends upon specific task parameters. The development of the task, the issues to be resolved and the pattern of performance, perceived workload and stress associated with performing such dynamic vigilance are reported. Practitioner Summary: The present experiment establishes a dynamic, first-person perspective movement-based vigilance task using a video-game environment. ‘Vigilance on the move’ is thus a new paradigm for the evaluation of sustained attention in operational environments in which individuals move as they monitor their environment. Issues addressed in task development are described.

[1]  M. Scerbo What's so boring about vigilance? , 1998 .

[2]  C. E. Webber,et al.  Effects of Knowledge of Results and Differential Monetary Reward on Six Uninterrupted Hours of Monitoring , 1965, Human factors.

[3]  P. A. Hancock,et al.  Experimental Evaluations of a Model of Mental Workload , 1989, Human factors.

[4]  Mary Ann Lavin,et al.  “Vigilance: The Essence of Nursing” , 2005, Online journal of issues in nursing.

[5]  R. R. Mackie,et al.  A Study of the Combined Effects of Extended Driving and Heat Stress on Driver Arousal and Performance , 1977 .

[6]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[7]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[8]  P. Hancock,et al.  Cerebral lateralization of vigilance: A function of task difficulty , 2010, Neuropsychologia.

[9]  James L. Szalma,et al.  Effects of Training with Knowledge of Results on Diagnosticity in Vigilance Performance , 2009 .

[10]  Peter A. Hancock,et al.  Defeating Terrorism: What Can Human Factors/Ergonomics Offer? , 2002 .

[11]  P. Wouters,et al.  A meta-analysis of the cognitive and motivational effects of serious games , 2013 .

[12]  J. Szalma Workload and stress in vigilance: the impact of display format and task type. , 2011, The American journal of psychology.

[13]  D. Simons,et al.  The effects of video game playing on attention, memory, and executive control. , 2008, Acta psychologica.

[14]  James L. Szalma,et al.  Effects of Sensory Modality and Task Duration on Performance, Workload, and Stress in Sustained Attention , 2004, Hum. Factors.

[15]  Gerald Matthews,et al.  Stress state mediation between environmental variables and performance: the case of noise and vigilance. , 2009, Acta psychologica.

[16]  Grant S. Taylor,et al.  Individual differences in response to automation: the five factor model of personality. , 2011, Journal of experimental psychology. Applied.

[17]  C G Drury,et al.  The analysis of industrial inspection. , 1971, Applied ergonomics.

[18]  Gerald Matthews,et al.  Task-Induced Stress and Individual Differences in Coping , 1998 .

[19]  William N. Dember,et al.  VIGILANCE AND WORKLOAD IN AUTOMATED SYSTEMS. , 1996 .

[20]  P. Hancock,et al.  In search of vigilance: the problem of iatrogenically created psychological phenomena. , 2013, The American psychologist.

[21]  Joel S. Warm,et al.  Selection for vigilance assignments: a review and proposed new direction , 2011 .

[22]  S. Melamed,et al.  Objective and subjective work monotony: effects on job satisfaction, psychological distress, and absenteeism in blue-collar workers. , 1995, The Journal of applied psychology.

[23]  Colin G. Drury,et al.  Sustained Attention in Operational Settings , 2015 .

[24]  Karl M Newell,et al.  The movement speed-accuracy relation in space-time. , 2013, Human movement science.

[25]  Joel S. Warm,et al.  The Effects of Signal Salience and Caffeine on Performance, Workload, and Stress in an Abbreviated Vigilance Task , 2000, Hum. Factors.

[26]  Lea Fleischer,et al.  The Senses Considered As Perceptual Systems , 2016 .

[27]  M. Coles,et al.  Energetics and Human Information Processing , 1986 .

[28]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[29]  James L. Szalma,et al.  Training for Vigilance: Using Predictive Power to Evaluate Feedback Effectiveness , 2006, Hum. Factors.

[30]  Kelley S. Parsons Detection-Action Sequence in Vigilance: Effects on Workload and Stress , 2007 .

[31]  Shamus P. Smith,et al.  Exploring the effectiveness of commercial and custom-built games for cognitive training , 2013, Comput. Hum. Behav..

[32]  J. Szalma Individual differences: incorporating human variation into human factors/ergonomics research and practice , 2009 .

[33]  W. Helton,et al.  Natural scene stimuli and lapses of sustained attention , 2012, Consciousness and Cognition.

[34]  H Cook,et al.  The price of freedom. , 1986, The Health service journal.

[35]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[36]  W. Helton,et al.  Target predictability, sustained attention, and response inhibition , 2013, Brain and Cognition.

[37]  Raja Parasuraman,et al.  The role of memory representation in the vigilance decrement , 2004, Psychonomic bulletin & review.

[38]  N. Mackworth The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[39]  Tyler H. Shaw,et al.  Effects of warned and unwarned demand transitions on vigilance performance and stress , 2008, Anxiety, stress, and coping.

[40]  I. Mack,et al.  Vigilance Latencies to Aircraft Detection among NORAD Surveillance Operators , 1995, Hum. Factors.

[41]  Stephen Kaplan,et al.  The restorative benefits of nature: Toward an integrative framework , 1995 .

[42]  Peter A. Hancock,et al.  Time-to-Contact: More Than Tau Alone , 1997 .

[43]  W. N. Dember,et al.  Vigilance: Taxonomy And Utility , 1987 .

[44]  W. N. Dember,et al.  Tests of vigilance taxonomy. , 1998 .

[45]  James L. Szalma,et al.  Individual differences in human–technology interaction: incorporating variation in human characteristics into human factors and ergonomics research and design , 2009 .

[46]  Anthony E. Richardson,et al.  Video game experience predicts virtual, but not real navigation performance , 2011, Comput. Hum. Behav..

[47]  H. J. Eysenck,et al.  Researches on the measurement of human performance. , 1951 .

[48]  Joel S. Warm,et al.  Vigilance and Workload , 1991 .

[49]  Joel S. Warm,et al.  A Comparison of Cerebral Hemovelocity and Blood Oxygen Saturation Levels during Vigilance Performance , 2010 .

[50]  N S Paget,et al.  Factors Affecting an Anaesthetist's Work: Some Findings on Vigilance and Performance , 1981, Anaesthesia and intensive care.

[51]  Joel S. Warm,et al.  Viewing the Workload of Vigilance Through the Lenses of the NASA-TLX and the MRQ , 2013, Hum. Factors.

[52]  James L. Szalma,et al.  The Effect of Video Game Play on Performance in a Vigilance Task , 2012 .

[53]  P. Hancock,et al.  The Cambridge handbook of applied perception research , 2015 .

[54]  Steven C. Sutherland,et al.  Individual Differences in Causal Judgment under Time Pressure: Sex and Prior Video Game Experience as Predictors , 2011, International Journal of Comparative Psychology.

[55]  James L. Szalma,et al.  The Effect of Knowledge of Results for Training Vigilance in a Video Game-Based Environment , 2012 .

[56]  R. Parasuraman,et al.  Sensory and Cognitive Vigilance: Effects of Age on Performance and Subjective Workload , 1993 .

[57]  Holly E. Hancock,et al.  Perception and Comprehension of Consumer Warning Information from Both Ecological and Age-Related Perspectives , 1998 .

[58]  P. Hancock,et al.  A Dynamic Model of Stress and Sustained Attention , 1989, Human factors.

[59]  Gerald Matthews,et al.  Dundee Stress State Questionnaire , 2014 .

[60]  P.A. Hancock,et al.  Individuation: the N = 1 revolution , 2009 .

[61]  Joel S. Warm,et al.  Effects of Cueing and Knowledge of Results on Workload and Boredom in Sustained Attention , 1999, Hum. Factors.

[62]  J. Pratt,et al.  Playing an Action Video Game Reduces Gender Differences in Spatial Cognition , 2007, Psychological science.

[63]  W. T. Nelson,et al.  Target Acquisition With UAVs: Vigilance Displays and Advanced Cuing Interfaces , 2005, Hum. Factors.

[64]  Piotr Stefan Wandycz,et al.  The Price of Freedom , 1992 .

[65]  R. Engels,et al.  The benefits of playing video games. , 2014, The American psychologist.

[66]  Arie Shirom,et al.  The Effects of Pay Systems on Blue-Collar Employees' Emotional Distress: The Mediating Effects of Objective and Subjective Work Monotony , 1999 .

[67]  James L. Szalma,et al.  Knowledge of Results and Diagnostic Power , 2011 .

[68]  Mark W. Wiggins,et al.  Vigilance decrement during a simulated general aviation flight , 2011 .

[69]  Judi E. See,et al.  Meta-analysis of the sensitivity decrement in vigilance. , 1995 .

[70]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[71]  G. R. J. Hockey Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework , 1997, Biological Psychology.

[72]  Leonard A. Annetta The “I's” Have It: A Framework for Serious Educational Game Design , 2010 .

[73]  Andrew J Young,et al.  Cognitive function and mood during acute cold stress after extended military training and recovery. , 2009, Aviation, space, and environmental medicine.

[74]  James L. Szalma,et al.  Action Video Game Players and Vigilance Performance , 2013 .

[75]  C. S. Green,et al.  Action video game modifies visual selective attention , 2003, Nature.

[76]  William S. Helton,et al.  Perceptual decoupling or motor decoupling? , 2013, Consciousness and Cognition.

[77]  J. Arruda,et al.  Rhythmic Oscillations in the Performance of a Sustained Attention Task , 2003, Journal of clinical and experimental neuropsychology.

[78]  H. Gr Compensatory control in the regulation of human performance under stress and high workload; a cognitive-energetical framework. , 1997 .

[79]  Joel S. Warm,et al.  The Psychophysics of Vigilance , 1980 .

[80]  Peter A. Hancock,et al.  Hedonomics: The Power of Positive and Pleasurable Ergonomics , 2005 .

[81]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[82]  James L Szalma,et al.  Spatial and temporal task characteristics as stress: a test of the dynamic adaptability theory of stress, workload, and performance. , 2012, Acta psychologica.

[83]  Mark W. Scerbo,et al.  50 Years of Vigilance Research: Where are we now? , 1998 .

[84]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[85]  Scott D. Brown,et al.  Gamelike features might not improve data , 2013, Behavior research methods.

[86]  P A Hancock,et al.  Effects of control order, augmented feedback, input device and practice on tracking performance and perceived workload. , 1996, Ergonomics.

[87]  Matthew S Cain,et al.  Action video game experience reduces the cost of switching tasks , 2012, Attention, Perception, & Psychophysics.