Eye-Tracking in the Study of Visual Expertise: Methodology and Approaches in Medicine

Eye-tracking is the measurement of eye motions and point of gaze of a viewer. Advances in this technology have been essential to our understanding of many forms of visual learning, including the development of visual expertise. In recent years, these studies have been extended to the medical professions, where eye-tracking technology has helped us to understand acquired visual expertise, as well as the importance of visual training in various medical specialties. Medical decision-making involves a complex interplay between knowledge and sensory information, and the study of eye-movements can reveal the mechanisms involved in acquiring the visual component of these skills. Eye-tracking studies have even been extended to develop computational models of procedures for “expert” skill assessment, and to eliminate potential sources of error in image-based diagnostics. This review will examine the current eye-tracking frontier for the study of visual expertise, with specific application to medical professions.

[1]  Elizabeth A. Krupinski,et al.  Understanding Visual Search Patterns of Dermatologists Assessing Pigmented Skin Lesions Before and After Online Training , 2014, Journal of Digital Imaging.

[2]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.

[3]  Li Liu,et al.  Calibration algorithm for eyetracking with unrestricted head movement , 2007, Behavior research methods.

[4]  J. Wolfe,et al.  The Invisible Gorilla Strikes Again , 2013, Psychological science.

[5]  Emma Helbren,et al.  Tracking eye gaze during interpretation of endoluminal three-dimensional CT colonography: visual perception of experienced and inexperienced readers. , 2014, Radiology.

[6]  Trafton Drew,et al.  HOW DO RADIOLOGISTS USE THE HUMAN SEARCH ENGINE? , 2016, Radiation protection dosimetry.

[7]  Won-Ki Jeong,et al.  Interactive Histology of Large-Scale Biomedical Image Stacks , 2010, IEEE Transactions on Visualization and Computer Graphics.

[8]  Karla K. Evans,et al.  The gist of the abnormal: Above-chance medical decision making in the blink of an eye , 2013, Psychonomic Bulletin & Review.

[9]  Claudia Mello-Thoms,et al.  Using gaze-tracking data and mixture distribution analysis to support a holistic model for the detection of cancers on mammograms. , 2008, Academic radiology.

[10]  Hirotaka Aoki,et al.  Eye-tracking analysis of skilled performance in clinical extracorporeal circulation , 2012, Journal of Artificial Organs.

[11]  Looking to the eyes influences the processing of emotion on face‐sensitive event‐related potentials in 7‐month‐old infants , 2015, Developmental neurobiology.

[12]  D. Fisher,et al.  Using an Eye Tracker During Medication Administration to Identify Gaps in Nursing Students’ Contextual Knowledge: An Observational Study , 2015, Nurse educator.

[13]  O. Pascalis,et al.  Plasticity of face processing in infancy. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Heinrich H. Bülthoff,et al.  A comparison of geometric- and regression-based mobile gaze-tracking , 2014, Front. Hum. Neurosci..

[15]  J. Braun.  Visual search among items of different salience: removal of visual attention mimics a lesion in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[17]  Gabor Fichtinger,et al.  An objective and automated method for assessing surgical skill in endoscopic sinus surgery using eye‐tracking and tool‐motion data , 2012, International forum of allergy & rhinology.

[18]  Gezheng Wen,et al.  Computational assessment of visual search strategies in volumetric medical images , 2016, Journal of medical imaging.

[19]  David C Wilbur,et al.  Ovarian frozen section diagnosis: use of whole-slide imaging shows excellent correlation between virtual slide and original interpretations in a large series of cases. , 2010, Archives of pathology & laboratory medicine.

[20]  J Merchant,et al.  Remote measurement of eye direction allowing subject motion over one cubic foot of space. , 1974, IEEE transactions on bio-medical engineering.

[21]  Trafton Drew,et al.  Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images? , 2013, Radiographics : a review publication of the Radiological Society of North America, Inc.

[22]  Bruno Rossion,et al.  Long-term Expertise with Artificial Objects Increases Visual Competition with Early Face Categorization Processes , 2007, Journal of Cognitive Neuroscience.

[23]  Maciej A Mazurowski,et al.  Exploring the potential of context-sensitive CADe in screening mammography. , 2010, Medical physics.

[24]  Anthony W. Sali,et al.  The role of reward prediction in the control of attention. , 2014, Journal of experimental psychology. Human perception and performance.

[25]  Isabel Gauthier,et al.  The development of face expertise , 2001, Current Opinion in Neurobiology.

[26]  Cindy M. Bukach,et al.  Beyond faces and modularity: the power of an expertise framework , 2006, Trends in Cognitive Sciences.

[27]  Fred W. Mast,et al.  What Was I Thinking? Eye-Tracking Experiments Underscore the Bias that Architecture Exerts on Nuclear Grading in Prostate Cancer , 2012, PloS one.

[28]  Jimmie Stewart,et al.  Virtual microscopy for cytology proficiency testing: Are we there yet? , 2007, Cancer.

[29]  H D Crane,et al.  Generation-V dual-Purkinje-image eyetracker. , 1985, Applied optics.

[30]  M. S. Atkins,et al.  Eye trackers in a virtual laparoscopic training environment. , 2003, Studies in health technology and informatics.

[31]  H. A. Mooij,et al.  Visualising scanning patterns of pathologists in the grading of cervical intraepithelial neoplasia , 2003, Journal of clinical pathology.

[32]  Charles A. Nelson,et al.  Eye-Tracking, Autonomic, and Electrophysiological Correlates of Emotional Face Processing in Adolescents with Autism Spectrum Disorder , 2013, Journal of autism and developmental disorders.

[33]  Donald L Fisher,et al.  Eye Tracking as a Debriefing Mechanism in the Simulated Setting Improves Patient Safety Practices , 2014, Dimensions of critical care nursing : DCCN.

[34]  J M Wolfe,et al.  The pertinence of research on visual search to radiologic practice. , 1995, Academic radiology.

[35]  Masaru Ishii,et al.  Robotic Path Planning for Surgeon Skill Evaluation in Minimally-Invasive Sinus Surgery , 2012, MICCAI.

[36]  D. Fisher,et al.  Nurses' behaviors and visual scanning patterns may reduce patient identification errors. , 2011, Journal of experimental psychology. Applied.

[37]  Karla K. Evans,et al.  If You Don’t Find It Often, You Often Don’t Find It: Why Some Cancers Are Missed in Breast Cancer Screening , 2013, PloS one.

[38]  J. Wolfe,et al.  Seek and you shall remember: scene semantics interact with visual search to build better memories. , 2014, Journal of vision.

[39]  Masaru Ishii,et al.  Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty , 2015, International Journal of Computer Assisted Radiology and Surgery.

[40]  D. Fisher,et al.  What Do Physicians Read (and Ignore) in Electronic Progress Notes? , 2014, Applied Clinical Informatics.

[41]  J. Wolfe.  Saved by a Log , 2012, Psychological science.

[42]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[43]  Steve Halligan,et al.  Method for tracking eye gaze during interpretation of endoluminal 3D CT colonography: technical description and proposed metrics for analysis. , 2013, Radiology.

[44]  Bodo Winter,et al.  Processing motion implied in language: eye-movement differences during aspect comprehension , 2012, Cognitive Processing.

[45]  K. Scheiter,et al.  Conveying clinical reasoning based on visual observation via eye-movement modelling examples , 2012, Instructional Science.

[46]  Naomi M. Kenner,et al.  Low target prevalence is a stubborn source of errors in visual search tasks. , 2007, Journal of experimental psychology. General.

[47]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[48]  Jeremy M Wolfe,et al.  When do I quit? The search termination problem in visual search. , 2012, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[49]  R. Dodge,et al.  The angular velocity of eye movements , 1901 .

[50]  Tad T. Brunyé,et al.  Eye Movements as an Index of Pathologist Visual Expertise: A Pilot Study , 2014, PloS one.

[51]  Patryk A. Laurent,et al.  Valuable orientations capture attention , 2015, Visual cognition.

[52]  Erik D. Reichle,et al.  Eye movements in reading and information processing : , 2015 .

[53]  J. Wolfe,et al.  Varying Target Prevalence Reveals Two Dissociable Decision Criteria in Visual Search , 2010, Current Biology.

[54]  Miguel P Eckstein,et al.  Visual search: a retrospective. , 2011, Journal of vision.

[55]  E. Krupinski,et al.  Eye-movement study and human performance using telepathology virtual slides: implications for medical education and differences with experience. , 2006, Human pathology.

[56]  Elizabeth A. Krupinski,et al.  Research and applications: Investigating the link between radiologists' gaze, diagnostic decision, and image content , 2013, J. Am. Medical Informatics Assoc..

[57]  Naomi M. Kenner,et al.  How fast can you change your mind? The speed of top-down guidance in visual search , 2004, Vision Research.

[58]  Jeremy M Wolfe,et al.  Prevalence of abnormalities influences cytologists' error rates in screening for cervical cancer. , 2011, Archives of pathology & laboratory medicine.