Cue utilisation predicts control room operators’ performance in a sustained visual search task

Abstract This research was designed to determine whether qualified practitioners’ cue utilisation is predictive of their performance during a sustained visual search task in an operational context. Australian Distribution Network Service Provider (DNSP) operators were recruited for two experiments, and were classified with either higher or lower cue utilisation based on an assessment of cue utilisation within the context of power distribution. Operators’ performance was assessed using a domain-related sustained visual search task. In both experiments, power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, compared to operators with lower cue utilisation. Further, no differences in accuracy based on cue utilisation were observed during the sustained visual search task. The results are consistent with the proposition that power operators with higher cue utilisation have a greater capacity to sustain visual search during domain-related tasks, compared to operators with lower cue utilisation. Practitioner summary: Power distribution system operators’ cue utilisation was used to predict performance during a domain-related sustained visual search task. Power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, but no differences in accuracy, compared to operators with lower cue utilisation. Abbreviations: DNSP: distribution network service provider; EXPERTise 2.0: EXPERT intensive skills evaluation; FAT: feature association task; FDT: feature discrimination task; FIT: feature identification task; fNIRS: functional near infrared spectroscopy; FPT: feature prioritisation task; FRT: feature recognition task; SCADA: supervisory control and data acquisition

[1]  Jaewhan Kim,et al.  Human Error Mode Identification for NPP Main Control Room Operations Using Soft Controls , 2011 .

[2]  R. Parasuraman.  Memory load and event rate control sensitivity decrements in sustained attention. , 1979, Science.

[3]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[4]  Mark W. Wiggins,et al.  Diagnosis and instructional systems design , 2015 .

[5]  Janet M. Noyes,et al.  People in control: human factors in control room design , 2001 .

[6]  P. Hancock,et al.  Cerebral lateralization of vigilance: A function of task difficulty , 2010, Neuropsychologia.

[7]  David O'Hare,et al.  Expert and Novice Pilot Perceptions of Static In-Flight Images of Weather , 2003 .

[8]  Shayne Loft,et al.  The development of a general associative learning account of skill acquisition in a relative arrival-time judgment task. , 2007, Journal of experimental psychology. Human perception and performance.

[9]  H. Pashler,et al.  Editors’ Introduction to the Special Section on Replicability in Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[10]  Mark W. Wiggins,et al.  Vigilance decrement during a simulated general aviation flight , 2011 .

[11]  Gary Klein,et al.  Rapid Decision Making on the Fire Ground , 1986 .

[12]  C. Stevens,et al.  Expert, intermediate and novice performance during simulated pre‐flight decision‐making , 2002 .

[13]  W. Helton,et al.  Signal salience and the mindlessness theory of vigilance. , 2008, Acta psychologica.

[14]  E. Brunswik.  Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[15]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[16]  Keryn A. Pauley,et al.  Measuring Expertise in Weather-Related Aeronautical Risk Perception: The Validity of the Cochran–Weiss–Shanteau (CWS) Index , 2009 .

[17]  Dakota Evans,et al.  A multi-measure approach for connecting cognitive workload and automation , 2017, Int. J. Hum. Comput. Stud..

[18]  William S. Helton,et al.  Visuospatial and verbal working memory load: effects on visuospatial vigilance , 2012, Experimental Brain Research.

[19]  Thomas Loveday,et al.  “Experience Isn’t Everything”: How Emotion Affects the Relationship Between Experience and Cue Utilization , 2018, Hum. Factors.

[20]  Guy H. Walker,et al.  Human Factors in the Design and Evaluation of Central Control Room Operations , 2009 .

[21]  Thomas Loveday,et al.  Cue-Based Processing Capacity, Cognitive Load and the Completion of Simulated Short-Duration Vigilance Tasks in Power Transmission Control , 2014 .

[22]  A. Williams,et al.  Anticipation skill in a real-world task: measurement, training, and transfer in tennis. , 2002, Journal of experimental psychology. Applied.

[23]  Kelley S. Parsons,et al.  The abbreviated vigilance task and cerebral hemodynamics , 2007, Journal of clinical and experimental neuropsychology.

[24]  Jonathan W. Schooler,et al.  Metascience could rescue the ‘replication crisis’ , 2014, Nature.

[25]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[26]  S. Eickhoff,et al.  Sustaining attention to simple tasks: a meta-analytic review of the neural mechanisms of vigilant attention. , 2013, Psychological bulletin.

[27]  Mark W. Wiggins,et al.  Can reduced processing decision support interfaces improve the decision-making of less-experienced incident commanders? , 2012, Decis. Support Syst..

[28]  Ben W. Morrison,et al.  Measuring Relative Cue Strength as a Means of Validating an Inventory of Expert Offender Profiling Cues , 2013 .

[29]  J. Reason.  Human error: models and management , 2000, BMJ : British Medical Journal.

[30]  Thomas Loveday,et al.  The Capability of Static and Dynamic Features to Distinguish Competent From Genuinely Expert Practitioners in Pediatric Diagnosis , 2013, Hum. Factors.

[31]  David O'Hare,et al.  The role of cue utilisation in reducing the workload in a train control task , 2017, Ergonomics.

[32]  J. Klayman.  Cue discovery in probabilistic environments: Uncertainty and experimentation. , 1988 .

[33]  Christopher D. Wickens,et al.  Introduction to Engineering Psychology and Human Performance , 2015 .

[34]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[35]  L. Bertling,et al.  Probabilistic security assessment for power system operations , 2004, IEEE Power Engineering Society General Meeting, 2004..

[36]  Thomas Loveday,et al.  Pattern recognition as an indicator of diagnostic expertise , 2013 .

[37]  Jaime C. Auton,et al.  Cue utilization differentiates resource allocation during sustained attention simulated rail control tasks. , 2019, Journal of experimental psychology. Applied.

[38]  Ben J. Searle,et al.  Cue Utilization and Broad Indicators of Workplace Expertise , 2014 .

[39]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[40]  M. Wiggins,et al.  Trait-based cue Utilization and initial skill acquisition: implications for models of the progression to expertise , 2014, Front. Psychol..

[41]  D. Besner,et al.  A Resource-Control Account of Sustained Attention , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[42]  Michael D. Byrne,et al.  Cue effectiveness in mitigating postcompletion errors in a routine procedural task , 2008, Int. J. Hum. Comput. Stud..

[43]  Mark W. Wiggins,et al.  Differences in situation assessments and prospective diagnoses of simulated weather radar returns amongst experienced pilots , 2014 .

[44]  Jaime C. Auton,et al.  Control Room Operators’ Cue Utilization Predicts Cognitive Resource Consumption During Regular Operational Tasks , 2019, Front. Psychol..

[45]  Dennis B. Beringer,et al.  Priority and Organization of Information Accessed by Pilots in Various Phases of Flight , 2001 .

[46]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[47]  Thomas Loveday,et al.  Expert and competent non-expert visual cues during simulated diagnosis in intensive care , 2014, Front. Psychol..

[48]  David O'Hare,et al.  Expertise in aeronautical weather-related decision making: A cross-sectional analysis of general aviation pilots , 1995 .

[49]  J. Shaoul.  Human Error , 1973, Nature.

[50]  G. Underwood,et al.  Something Overlooked? How experts in change detection use visual saliency , 2010 .

[51]  J.M. O'Hara,et al.  Advanced control rooms and crew performance issues: implications for human reliability , 1991, Conference Record of the 1991 IEEE Nuclear Science Symposium and Medical Imaging Conference.

[52]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[53]  Tyler H. Shaw,et al.  Effects of sensory modality on cerebral blood flow velocity during vigilance , 2009, Neuroscience Letters.

[54]  Daniel G. Morrow,et al.  Expertise Differences in Attentional Strategies Related to Pilot Decision Making , 2008, Hum. Factors.

[55]  B. Abernethy,et al.  How do World-Class Cricket Batsmen Anticipate a Bowler's Intention? , 2006, Quarterly journal of experimental psychology.

[56]  David J. Weiss,et al.  Empirical Assessment of Expertise , 2003, Hum. Factors.

[57]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[58]  N. Mackworth.  The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[59]  James L. Szalma,et al.  The Vigilance Decrement Reflects Limitations in Effortful Attention, Not Mindlessness , 2003, Hum. Factors.

[60]  W. Helton,et al.  Cue Utilization and Cognitive Load in Novel Task Performance , 2016, Front. Psychol..

[61]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[62]  P. Hancock,et al.  A Dynamic Model of Stress and Sustained Attention , 1989, Human factors.

[63]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[64]  David O'Hare,et al.  Weatherwise: Evaluation of a Cue-Based Training Approach for the Recognition of Deteriorating Weather Conditions during Flight , 2003, Hum. Factors.