Differentiating Experience From Cue Utilization in Radiological Assessments

Objective This research was designed to examine the contribution of self-reported experience and cue utilization to diagnostic accuracy in the context of radiology. Background Within radiology, it is unclear how task-related experience contributes to the acquisition of associations between features with events in memory, or cues, and how they contribute to diagnostic performance. Method Data were collected from 18 trainees and 41 radiologists. The participants completed a radiology edition of the established cue utilization assessment tool EXPERTise 2.0, which provides a measure of cue utilization based on performance on a number of domain-specific tasks. The participants also completed a separate image interpretation task as an independent measure of diagnostic performance. Results Consistent with previous research, a k-means cluster analysis using the data from EXPERTise 2.0 delineated two groups, the pattern of centroids of which reflected higher and lower cue utilization. Controlling for years of experience, participants with higher cue utilization were more accurate on the image interpretation task compared to participants who demonstrated relatively lower cue utilization (p = .01). Conclusion This study provides support for the role of cue utilization in assessments of radiology images among qualified radiologists. Importantly, it also demonstrates that cue utilization and self-reported years of experience as a radiologist make independent contributions to performance on the radiological diagnostic task. Application Task-related experience, including training, needs to be structured to ensure that learners have the opportunity to acquire feature–event relationships and internalize these associations in the form of cues in memory.

[1]  Karla K. Evans,et al.  The gist of the abnormal: Above-chance medical decision making in the blink of an eye , 2013, Psychonomic Bulletin & Review.

[2]  Ann J. Carrigan,et al.  Exploring the effect of context and expertise on attention: is attention shifted by information in medical images? , 2019, Attention, Perception, & Psychophysics.

[3]  P. Goddard,et al.  Error in radiology. , 2001, The British journal of radiology.

[4]  H L Kundel,et al.  Visual search patterns and experience with radiological images. , 1972, Radiology.

[5]  I. Rock,et al.  Inattentional blindness: Perception without attention. , 1998 .

[6]  M. Wiggins,et al.  Trait-based cue Utilization and initial skill acquisition: implications for models of the progression to expertise , 2014, Front. Psychol..

[7]  Leonard Berlin,et al.  Errors of omission. , 2005, AJR. American journal of roentgenology.

[8]  Matthew S Cain,et al.  Self-Induced Attentional Blink , 2013, Psychological science.

[9]  H L Kundel,et al.  Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. , 1978, Investigative radiology.

[10]  Mark W. Wiggins,et al.  The role of cue utilisation and adaptive interface design in the management of skilled performance in operations control , 2014 .

[11]  Matthew S. Cain,et al.  Improved control of exogenous attention in action video game players , 2014, Front. Psychol..

[12]  Keryn A. Pauley,et al.  Measuring Expertise in Weather-Related Aeronautical Risk Perception: The Validity of the Cochran–Weiss–Shanteau (CWS) Index , 2009 .

[13]  Trafton Drew,et al.  What do we know about volumetric medical image interpretation?: a review of the basic science and medical image perception literatures , 2019, Cognitive Research: Principles and Implications.

[14]  Ben J. Searle,et al.  Cue Utilization and Broad Indicators of Workplace Expertise , 2014 .

[15]  Ziba Gandomkar,et al.  Radiologists can detect the ‘gist’ of breast cancer before any overt signs of cancer appear , 2018, Scientific Reports.

[16]  Emma C. Falkland,et al.  Cross-task cue utilisation and situational awareness in simulated air traffic control. , 2019, Applied ergonomics.

[17]  Jaime C. Auton,et al.  Postgraduate training in audiology improves clinicians’ audiology-related cue utilisation , 2018, International journal of audiology.

[18]  David O'Hare,et al.  Expertise in aeronautical weather-related decision making: A cross-sectional analysis of general aviation pilots , 1995 .

[19]  Stephen R. Mitroff,et al.  Self-induced attentional blink: A cause of errors in multiple-target visual search , 2012 .

[20]  Mackenzie A. Sunday,et al.  Both fluid intelligence and visual object recognition ability relate to nodule detection in chest radiographs , 2018, Applied Cognitive Psychology.

[21]  Ben W. Morrison,et al.  Measuring Relative Cue Strength as a Means of Validating an Inventory of Expert Offender Profiling Cues , 2013 .

[22]  Kevin S. Berbaum,et al.  Satisfaction of search in diagnostic radiology. , 1989 .

[23]  David O'Hare,et al.  The role of cue utilisation in reducing the workload in a train control task , 2017, Ergonomics.

[24]  D. Hambrick,et al.  On Behalf Of: Association for Psychological Science Onlinefirst Version of Record >> Deliberate Practice and Performance in Music, Games, Sports, Education, and Professions: a Meta-analysis the Current Meta-analysis Effect Sizes Meta-analytic Procedure , 2022 .

[25]  Pat Croskerry,et al.  A universal model of diagnostic reasoning. , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[26]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[27]  Thomas Loveday,et al.  “Experience Isn’t Everything”: How Emotion Affects the Relationship Between Experience and Cue Utilization , 2018, Hum. Factors.

[28]  Isabel Gauthier,et al.  General object recognition is specific: Evidence from novel and familiar objects , 2017, Cognition.

[29]  Katherine P Andriole,et al.  Optimizing analysis, visualization, and navigation of large image data sets: one 5000-section CT scan can ruin your whole day. , 2011, Radiology.

[30]  D. Berry,et al.  Benefits and harms of CT screening for lung cancer: a systematic review. , 2012, JAMA.

[31]  Jennifer L. Bath,et al.  the potential role of , 2017 .

[32]  Anina N. Rich,et al.  Finding cancer in mammograms: if you know it’s there, do you know where? , 2018, Cognitive research: principles and implications.

[33]  Sallie J. Weaver,et al.  Cognitive and system factors contributing to diagnostic errors in radiology. , 2013, AJR. American journal of roentgenology.

[34]  E. Brunswik Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[35]  Mark W. Wiggins,et al.  Cue-Utilisation Typologies and Pilots’ Pre-Flight and In-Flight Weather Decision-Making , 2014 .

[36]  H L Kundel,et al.  Interpreting chest radiographs without visual search. , 1975, Radiology.

[37]  W. J. Tuddenham Visual search, image organization, and reader error in roentgen diagnosis. Studies of the psycho-physiology of roentgen image perception. , 1962, Radiology.

[38]  Guillermo Campitelli,et al.  Beyond Born versus Made: A New Look at Expertise , 2015 .

[39]  P. Ackerman Nonsense, common sense, and science of expert performance: Talent and individual differences , 2014 .

[40]  Warwick B. Lee,et al.  Markers of good performance in mammography depend on number of annual readings. , 2013, Radiology.

[41]  Jaime C. Auton,et al.  Control Room Operators’ Cue Utilization Predicts Cognitive Resource Consumption During Regular Operational Tasks , 2019, Front. Psychol..

[42]  I. Gauthier,et al.  A visual short-term memory advantage for faces , 2007, Psychonomic bulletin & review.

[43]  Kent R Van Sickle,et al.  Music Experience Influences Laparoscopic Skills Performance , 2008, JSLS : Journal of the Society of Laparoendoscopic Surgeons.

[44]  Sue Brouwers,et al.  The Potential Role of Context-Related Exposure in Explaining Differences in Water Safety Cue Utilization , 2019, Hum. Factors.

[45]  David O'Hare,et al.  Weatherwise: Evaluation of a Cue-Based Training Approach for the Recognition of Deteriorating Weather Conditions during Flight , 2003, Hum. Factors.

[46]  C. Stevens,et al.  Expert, intermediate and novice performance during simulated pre‐flight decision‐making , 2002 .

[47]  J. Wolfe,et al.  The Invisible Gorilla Strikes Again , 2013, Psychological science.

[48]  A. Mack Inattentional Blindness , 2003 .

[49]  Isabel Gauthier,et al.  A visual short-term memory advantage for objects of expertise. , 2009, Journal of experimental psychology. Human perception and performance.

[50]  Thomas Loveday,et al.  The Capability of Static and Dynamic Features to Distinguish Competent From Genuinely Expert Practitioners in Pediatric Diagnosis , 2013, Hum. Factors.

[51]  David J. Weiss,et al.  Empirical Assessment of Expertise , 2003, Hum. Factors.

[52]  Carlee Beth Hawkins,et al.  Roles of domain knowledge and working memory capacity in components of skill in Texas Hold'Em poker , 2012 .

[53]  Justin M. Ericson,et al.  Mammography to tomosynthesis: examining the differences between two-dimensional and segmented-three-dimensional visual search , 2018, Cognitive research: principles and implications.

[54]  David O'Hare,et al.  An Objective Approach to Identifying Diagnostic Expertise Among Power System Controllers , 2013, Hum. Factors.

[55]  E. Krupinski,et al.  Perceptual skill, radiology expertise, and visual test performance with NINA and WALDO. , 1998, Academic radiology.

[56]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.