Eye tracking reveals expertise-related differences in the time-course of medical image inspection and diagnosis

Abstract. Purpose: Physicians’ eye movements provide insights into relative reliance on different visual features during medical image review and diagnosis. Current theories posit that increasing expertise is associated with relatively holistic viewing strategies activated early in the image viewing experience. This study examined whether early image viewing behavior is associated with experience level and diagnostic accuracy when pathologists and trainees interpreted breast biopsies. Approach: Ninety-two residents in training and experienced pathologists at nine major U.S. medical centers interpreted digitized whole slide images of breast biopsy cases while eye movements were monitored. The breadth of visual attention and frequency and duration of eye fixations on critical image regions were recorded. We dissociated eye movements occurring early during initial viewing (prior to first zoom) versus later viewing, examining seven viewing behaviors of interest. Results: Residents and faculty pathologists were similarly likely to detect critical image regions during early image viewing, but faculty members showed more and longer duration eye fixations in these regions. Among pathology residents, year of residency predicted increasingly higher odds of fixating on critical image regions during early viewing. No viewing behavior was significantly associated with diagnostic accuracy. Conclusions: Results suggest early detection and recognition of critical image features by experienced pathologists, with relatively directed and efficient search behavior. The results also suggest that the immediate distribution of eye movements over medical images warrants further exploration as a potential metric for the objective monitoring and evaluation of progress during medical training.

[1]  H. A. Mooij,et al.  Visualising scanning patterns of pathologists in the grading of cervical intraepithelial neoplasia , 2003, Journal of clinical pathology.

[2]  T. Donovan,et al.  Detection or decision errors? Missed lung cancer from the posteroanterior chest radiograph. , 2004, The British journal of radiology.

[3]  Maheswari S. Mukherjee,et al.  Optimal z-axis scanning parameters for gynecologic cytology specimens , 2013, Journal of pathology informatics.

[4]  Harold L. Kundel,et al.  A Short History of Image Perception in Medical Radiology , 2018, The Handbook of Medical Image Perception and Techniques.

[5]  Michael C Hout,et al.  Target templates: the precision of mental representations affects attentional guidance and decision-making in visual search , 2015, Attention, perception & psychophysics.

[6]  J. Kogan,et al.  Opening the black box of clinical skills assessment via observation: a conceptual model , 2011, Medical education.

[7]  Matthew Sibbald,et al.  Why verifying diagnostic decisions with a checklist can help: insights from eye tracking , 2015, Advances in health sciences education : theory and practice.

[8]  Marc F Joanisse,et al.  Selective attention to threat versus reward: meta-analysis and neural-network modeling of the dot-probe task. , 2008, Clinical psychology review.

[9]  Jerri D. Edwards,et al.  Systematic review and meta-analyses of useful field of view cognitive training , 2018, Neuroscience & Biobehavioral Reviews.

[10]  E. Krupinski,et al.  Eye-movement study and human performance using telepathology virtual slides: implications for medical education and differences with experience. , 2006, Human pathology.

[11]  L. Pantanowitz,et al.  Digital imaging for cytopathology: are we there yet? , 2011, Cytopathology : official journal of the British Society for Clinical Cytology.

[12]  Anand K. Gramopadhye,et al.  Evaluation of the effect of feedforward training displays of search strategy on visual search performance , 2006 .

[13]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[14]  Trafton Drew,et al.  A review of eye tracking for understanding and improving diagnostic interpretation , 2019, Cognitive Research: Principles and Implications.

[15]  Trafton Drew,et al.  Simple eye-movement feedback during visual search is not helpful , 2017, Cognitive research: principles and implications.

[16]  Claudia Mello-Thoms,et al.  Using gaze-tracking data and mixture distribution analysis to support a holistic model for the detection of cancers on mammograms. , 2008, Academic radiology.

[17]  Ignace T C Hooge,et al.  Gaze tracking accuracy in humans: One eye is sometimes better than two , 2018, Behavior Research Methods.

[18]  John V. Guttag,et al.  Introduction to Computation and Programming Using Python: With Application to Understanding Data , 2016 .

[19]  T. Crawford,et al.  How do radiologists do it? The influence of experience and training on searching for chest nodules. , 2006 .

[20]  J. Elmore,et al.  Diagnostic concordance among pathologists interpreting breast biopsy specimens. , 2015, JAMA.

[21]  K. Scheiter,et al.  Conveying clinical reasoning based on visual observation via eye-movement modelling examples , 2012, Instructional Science.

[22]  Gary Longton,et al.  Development of a diagnostic test set to assess agreement in breast pathology: practical application of the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) , 2013, BMC Women's Health.

[23]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[24]  R. Säljö,et al.  Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains , 2011 .

[25]  Ellen M. Kok,et al.  Looking in the Same Manner but Seeing it Differently: Bottom‐up and Expertise Effects in Radiology , 2012 .

[26]  P. Subramanian Active Vision: The Psychology of Looking and Seeing , 2006 .

[27]  Christian Lovis,et al.  Use of eye-tracking technology in clinical reasoning: a systematic review , 2015, MIE.

[28]  Anand K. Gramopadhye,et al.  Use of eye movements as feedforward training for a synthetic aircraft inspection task , 2005, CHI.

[29]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[30]  T. Crawford,et al.  Viewing another person's eye movements improves identification of pulmonary nodules in chest x-ray inspection. , 2010, Journal of experimental psychology. Applied.

[31]  Donald L Weaver,et al.  Second opinion in breast pathology: policy, practice and perception , 2014, Journal of Clinical Pathology.

[32]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[33]  Mark R. Wilson,et al.  Visual expertise in detecting and diagnosing skeletal fractures , 2013, Skeletal Radiology.

[34]  Claudia Mello-Thoms,et al.  Time course of perception and decision making during mammographic interpretation. , 2002, AJR. American journal of roentgenology.

[35]  H. Haider,et al.  Eye movement during skill acquisition: More evidence for the information-reduction hypothesis , 1999 .

[36]  Susan Brennan,et al.  Another person's eye gaze as a cue in solving programming problems , 2004, ICMI '04.

[37]  Rajendra Singh,et al.  Standardization in digital pathology: Supplement 145 of the DICOM standards , 2011, Journal of pathology informatics.

[38]  Brian D Corneil,et al.  Neuromuscular consequences of reflexive covert orienting , 2008, Nature Neuroscience.

[39]  Trafton Drew,et al.  What do we know about volumetric medical image interpretation?: a review of the basic science and medical image perception literatures , 2019, Cognitive Research: Principles and Implications.

[40]  R. Hanajima,et al.  Where Do Neurologists Look When Viewing Brain CT Images? An Eye-Tracking Study Involving Stroke Cases , 2011, PloS one.

[41]  Linda G. Shapiro,et al.  Characterizing Diagnostic Search Patterns in Digital Breast Pathology: Scanners and Drillers , 2018, Journal of Digital Imaging.

[42]  Ara Darzi,et al.  Eye-tracking technology in medical education: A systematic review , 2017, Medical teacher.

[43]  Rajesh Aggarwal,et al.  Technical-skills training in the 21st century. , 2006, The New England journal of medicine.

[44]  Jules Sumkin,et al.  Effects of lesion conspicuity on visual search in mammogram reading. , 2005, Academic radiology.

[45]  Patrik Pluchino,et al.  Eye-movement modeling of integrative reading of an illustrated text: Effects on processing and learning , 2015 .

[46]  Trafton Drew,et al.  One visual search, many memory searches: An eye-tracking investigation of hybrid search , 2017, Journal of vision.

[47]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[48]  E. Conant,et al.  Holistic component of image perception in mammogram interpretation: gaze-tracking study. , 2007, Radiology.

[49]  G. Szirtes,et al.  Improving seizure recognition by visual reinforcement , 2012 .

[50]  Justin M. Ericson,et al.  Mammography to tomosynthesis: examining the differences between two-dimensional and segmented-three-dimensional visual search , 2018, Cognitive research: principles and implications.

[51]  Andrew H. Beck,et al.  Region of Interest Identification and Diagnostic Agreement in Breast Pathology , 2016, Modern Pathology.

[52]  Kenneth Holmqvist,et al.  Visual expertise in paediatric neurology. , 2012, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[53]  Donald L Weaver,et al.  The diagnostic challenge of low-grade ductal carcinoma in situ. , 2017, European journal of cancer.

[54]  Tad T. Brunyé,et al.  Eye Movements as an Index of Pathologist Visual Expertise: A Pilot Study , 2014, PloS one.

[55]  Donald L Weaver,et al.  Understanding diagnostic variability in breast pathology: lessons learned from an expert consensus review panel , 2014, Histopathology.

[56]  Guang-Zhong Yang,et al.  Eye tracking for skills assessment and training: a systematic review. , 2014, The Journal of surgical research.

[57]  Bijan Najafi,et al.  A passing glance? Differences in eye tracking and gaze patterns between trainees and experts reading plain film bunion radiographs. , 2015, The Journal of foot and ankle surgery : official publication of the American College of Foot and Ankle Surgeons.

[58]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[59]  Stephen R. Mitroff,et al.  A taxonomy of errors in multiple-target visual search , 2013 .

[60]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.

[61]  Simon Cooper,et al.  Eye tracking to investigate cue processing in medical decision-making: A scoping review , 2017, Computers in Human Behavior.

[62]  K. Berbaum,et al.  Gaze dwell times on acute trauma injuries missed because of satisfaction of search. , 2001, Academic radiology.

[63]  Alastair G. Gale,et al.  Radiology image perception and observer performance: How does expertise and clinical information alter interpretation? Stroke detection explored through eye-tracking , 2009, Medical Imaging.

[64]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[65]  Harold L. Kundel,et al.  THE COGNITIVE SIDE OF VISUAL SEARCH IN RADIOLOGY , 1987 .