An Objective Approach to Identifying Diagnostic Expertise Among Power System Controllers

Objective: The present study investigated whether performance across a range of cue-based cognitive tasks differentiated the diagnostic performance of power control operators into three distinct groups, characteristic of novice, competence, and expertise. Background: Despite its increasing importance in the contemporary workplace, there is little understanding of the cognitive processes that distinguish novice, competent, and expert performance in the context of remote diagnosis. However, recent evidence suggests that cue acquisition and utilization may represent a mechanism by which the transition from novice to expertise occurs. Method: The study involved the application of four distinct cue-based tasks within the context of power system control. A total of 65 controllers, encompassing a range of industry experience, completed the tasks as part of an in-service training program. Results: Using a cluster analysis, it was possible to extract three distinct groups of operators on the basis of their performance in the cue-based tasks, and these groups corresponded to differences in diagnostic performance. Conclusion: The results indicate assessments of the capacity to extract and utilize cues were able to distinguish expert from competent practitioners in the context of power control. Application: Assessments of the capacity to extract and utilize cues may be used in the future to distinguish expert from nonexpert practitioners, particularly in the context of remote diagnosis.

[1]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  L. Brooks,et al.  Expertise in visual diagnosis: a review of the literature , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[3]  David O'Hare,et al.  Expertise in aeronautical weather-related decision making: A cross-sectional analysis of general aviation pilots , 1995 .

[4]  A. Williams,et al.  Anticipation and visual search behaviour in expert soccer goalkeepers , 2005, Ergonomics.

[5]  R. Watson,et al.  Clinical competence assessment in nursing: a systematic review of the literature. , 2002, Journal of advanced nursing.

[6]  J. Kolodner.  Educational implications of analogy. A view from case-based reasoning. , 1997, The American psychologist.

[7]  Philippe G Schyns,et al.  Diagnostic recognition: task constraints, object information, and their interactions , 1998, Cognition.

[8]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[9]  Dennis B. Beringer,et al.  Priority and Organization of Information Accessed by Pilots in Various Phases of Flight , 2001 .

[10]  B. Abernethy,et al.  How do World-Class Cricket Batsmen Anticipate a Bowler's Intention? , 2006, Quarterly journal of experimental psychology.

[11]  David J. Weiss,et al.  Empirical Assessment of Expertise , 2003, Hum. Factors.

[12]  B. Ackerman,et al.  The Effect of Recognition Experience on Cued Recall in Children and Adults. , 1984 .

[13]  K. A. Ericsson,et al.  Science Current Directions in Psychological of Expert and Exceptional Performance Capturing the Naturally Occurring Superior Performance of Experts in the Laboratory : toward a Science on Behalf Of: Association for Psychological Science , 2022 .

[14]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[15]  David O'Hare,et al.  Expert and Novice Pilot Perceptions of Static In-Flight Images of Weather , 2003 .

[16]  Jan Maarten Schraagen,et al.  How Experts Solve a Novel Problem in Experimental Design , 1993, Cogn. Sci..

[17]  C. Stevens,et al.  Expert, intermediate and novice performance during simulated pre‐flight decision‐making , 2002 .

[18]  A. D. D. Groot.  Thought and Choice in Chess , 1978 .

[19]  Mark S Horswill,et al.  Using fuzzy signal detection theory to determine why experienced and trained drivers respond faster than novices in a hazard perception test. , 2007, Accident; analysis and prevention.

[20]  John R. Anderson.  A spreading activation theory of memory. , 1983 .

[21]  David Brogan.  Visual search : proceedings of the First International Conference on Visual Search, University of Durham, England, September 5-9, 1988 , 1990 .

[22]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[23]  Daniel G. Morrow,et al.  Expertise Differences in Attentional Strategies Related to Pilot Decision Making , 2008, Hum. Factors.

[24]  D. Kahneman,et al.  Conditions for intuitive expertise: a failure to disagree. , 2009, The American psychologist.

[25]  R. Gray.  Attending to the execution of a complex sensorimotor skill: expertise differences, choking, and slumps. , 2004, Journal of experimental psychology. Applied.

[26]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[27]  G. Underwood,et al.  Something Overlooked? How experts in change detection use visual saliency , 2010 .

[28]  R. Ratcliff,et al.  Sequential effects in lexical decision: tests of compound-cue retrieval theory. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[29]  A. Williams,et al.  Mechanisms Underpinning Successful Decision Making in Skilled Youth Soccer Players: An Analysis of Visual Search Behaviors , 2007, Journal of motor behavior.

[30]  Alastair G. Gale,et al.  Visual search in breast cancer screening , 1993 .

[31]  David O'Hare,et al.  Applications of micro-simulation in cognitive skills development , 2006 .

[32]  H. Schmidt,et al.  On acquiring expertise in medicine , 1993 .

[33]  Nadia W. Mullen,et al.  Finding the right case: The role of predictive features in memory for aviation accidents , 2008 .

[34]  M. Wiggins,et al.  A skills-based approach to training aeronautical decisionmaking , 2018, Aviation Instruction and Training.

[35]  Waldemar Karwowski.  Applications of Microsimulation in Cognitive Skills Development , 2006 .

[36]  Angela Schieder,et al.  THE HUMAN-MACHINE INTERFACE AS AN EMERGING RISK , 2009 .

[37]  Albert N. Badre,et al.  Automatic chunk detection in human-computer interaction , 1994, AVI '94.

[38]  Roberta L. Klatzky,et al.  Expertise in a Computer Operating System: Conceptualization and Performance , 1990, Hum. Comput. Interact..

[39]  A. Elo.  The rating of chessplayers, past and present , 1978 .

[40]  N. Charness,et al.  Expert Performance Its Structure and Acquisition , 2002 .

[41]  N. Charness.  Memory for Chess Positions: Resistance to Interference. , 1976 .

[42]  K. A. Ericsson,et al.  Perceiving patterns in dynamic action sequences: Investigating the processes underpinning stimulus recognition and anticipation skill , 2009 .

[43]  Mark W. Wiggins.  Cue-based processing and human performance , 2006 .

[44]  E. Brunswik.  Perception and the Representative Design of Psychological Experiments , 1957 .

[45]  James Shanteau,et al.  Why study expert decision making? Some historical perspectives and comments. , 1992 .

[46]  E. Salas,et al.  Taking stock of naturalistic decision making , 2001 .

[47]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[48]  Alex Kirlik,et al.  Situation awareness as judgment II: Experimental demonstration , 2006 .

[49]  Hélène Eyrolle,et al.  Expertise in dynamic environments , 1997 .

[50]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[51]  Mark W. Wiggins,et al.  Heuristic-Based Information Acquisition and Decision Making Among Pilots , 2006, Hum. Factors.

[52]  Frederick Reif,et al.  Cognition for Interpreting Scientific Concepts: A Study of Acceleration , 1992 .

[53]  P H Harasym,et al.  Diagnostic reasoning strategies and diagnostic success , 2003, Medical education.

[54]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[55]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.