The Holistic Processing Account of Visual Expertise in Medical Image Perception: A Review

In the field of medical image perception, the holistic processing perspective contends that experts can rapidly extract global information about the image, which can be used to guide their subsequent search of the image (Swensson, 1980; Nodine and Kundel, 1987; Kundel et al., 2007). In this review, we discuss the empirical evidence supporting three different predictions that can be derived from the holistic processing perspective: Expertise in medical image perception is domain-specific, experts use parafoveal and/or peripheral vision to process large regions of the image in parallel, and experts benefit from a rapid initial glimpse of an image. In addition, we discuss a pivotal recent study (Litchfield and Donovan, 2016) that seems to contradict the assumption that experts benefit from a rapid initial glimpse of the image. To reconcile this finding with the existing literature, we suggest that global processing may serve multiple functions that extend beyond the initial glimpse of the image. Finally, we discuss future research directions, and we highlight the connections between the holistic processing account and similar theoretical perspectives and findings from other domains of visual expertise.

[1]  Andreas Gegenfurtner,et al.  The challenges of studying visual expertise in medical image diagnosis , 2017, Medical education.

[2]  J. V. van Merriënboer,et al.  Expertise in clinical pathology: combining the visual and cognitive perspective , 2015, Advances in health sciences education : theory and practice.

[3]  E. Conant,et al.  How experience and training influence mammography expertise. , 1999, Academic radiology.

[4]  C. Mello-Thoms,et al.  The perception of breast cancers-a spatial frequency analysis of what differentiates missed from reported cancers , 2003, IEEE Transactions on Medical Imaging.

[5]  Calvin F. Nodine,et al.  Eye Movements and the Detection of Lung Tumors in Chest Images , 1984 .

[6]  Elizabeth A. Krupinski,et al.  Practical Applications of Perceptual Research , 2000 .

[7]  Eyal M. Reingold,et al.  Eye Movement Monitoring as a Process Tracing Methodology in Decision Making Research , 2011 .

[8]  E. Krupinski,et al.  Anniversary paper: evaluation of medical imaging systems. , 2008, Medical physics.

[9]  Tad T. Brunyé,et al.  Eye Movements as an Index of Pathologist Visual Expertise: A Pilot Study , 2014, PloS one.

[10]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[11]  R. C. Murry,et al.  The effect of search time on perception. , 1981, Radiology.

[12]  H L Kundel,et al.  Searching for bone fractures: a comparison with pulmonary nodule search. , 1994, Academic radiology.

[13]  Rachel A Robbins,et al.  A Review and Clarification of the Terms “holistic,” “configural,” and “relational” in the Face Perception Literature , 2012, Front. Psychology.

[14]  N. Charness,et al.  Perception in chess: Evidence from eye movements , 2006 .

[15]  C. J. Ravesloot,et al.  How visual search relates to visual diagnostic performance: a narrative systematic review of eye-tracking research in radiology , 2017, Advances in health sciences education : theory and practice.

[16]  James W. Tanaka,et al.  Features, Configuration, and Holistic Face Processing , 2011 .

[17]  W E CHAMBERLAIN,et al.  Tuberculosis case finding; a comparison of the effectiveness of various roentgenographic and photofluorographic methods. , 1947, Journal of the American Medical Association.

[18]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[19]  A. Jacobs.  Eye-movement control in visual search: How direct is visual span control? , 1986, Perception & psychophysics.

[20]  Jeremy M Wolfe,et al.  Does visual expertise improve visual recognition memory? , 2011, Attention, perception & psychophysics.

[21]  H L Kundel,et al.  Searching for lung nodules. The guidance of visual scanning. , 1991, Investigative radiology.

[22]  Trafton Drew,et al.  HOW DO RADIOLOGISTS USE THE HUMAN SEARCH ENGINE? , 2016, Radiation protection dosimetry.

[23]  Joseph P Houghton,et al.  Diagnostic performance on briefly presented digital pathology images , 2015, Journal of pathology informatics.

[24]  L. W. Guiss,et al.  A petrospective view of survey photofluorograms of persons with lung cancer , 1960, Cancer.

[25]  R G Swensson,et al.  The value of searching films without specific preconceptions. , 1985, Investigative radiology.

[26]  Harold L. Kundel,et al.  THE COGNITIVE SIDE OF VISUAL SEARCH IN RADIOLOGY , 1987 .

[27]  Mark R. Wilson,et al.  Visual expertise in detecting and diagnosing skeletal fractures , 2013, Skeletal Radiology.

[28]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  Antje C Venjakob,et al.  Review of prospects and challenges of eye tracking in volumetric imaging , 2015, Journal of medical imaging.

[30]  J. Henderson,et al.  Initial scene representations facilitate eye movement guidance in visual search. , 2007, Journal of experimental psychology. Human perception and performance.

[31]  C. J. Ravesloot,et al.  Interpretation of radiological images: towards a framework of knowledge and skills , 2014, Advances in health sciences education : theory and practice.

[32]  Karl J. Friston,et al.  How Doctors Generate Diagnostic Hypotheses: A Study of Radiological Diagnosis with Functional Magnetic Resonance Imaging , 2011, PloS one.

[33]  L. Brooks,et al.  Expertise in visual diagnosis: a review of the literature , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[34]  Georgia D. Tourassi,et al.  Investigating the association of eye gaze pattern and diagnostic error in mammography , 2013, Medical Imaging.

[35]  R. Hanajima,et al.  Where Do Neurologists Look When Viewing Brain CT Images? An Eye-Tracking Study Involving Stroke Cases , 2011, PloS one.

[36]  Stephen A. Engel,et al.  Engagement of Fusiform Cortex and Disengagement of Lateral Occipital Cortex in the Acquisition of Radiological Expertise , 2009, Cerebral cortex.

[37]  Claudia Mello-Thoms,et al.  Time course of perception and decision making during mammographic interpretation. , 2002, AJR. American journal of roentgenology.

[38]  Karla K. Evans,et al.  The gist of the abnormal: Above-chance medical decision making in the blink of an eye , 2013, Psychonomic Bulletin & Review.

[39]  J. B. Andosca,et al.  Tuberculosis case finding. , 1946, The New England journal of medicine.

[40]  E. Reingold,et al.  Eye movements and visual expertise in chess and medicine , 2011 .

[41]  H L Kundel,et al.  Comparison scans while reading chest images. Taught, but not practiced. , 1984, Investigative radiology.

[42]  Jeroen J. G. van Merriënboer,et al.  Tracks to a Medical Diagnosis: Expertise Differences in Visual Problem Solving , 2016 .

[43]  C. Nodine,et al.  Nature of expertise in searching mammograms for breast masses , 1996, Medical Imaging.

[44]  H L Kundel,et al.  Finding lung nodules with and without comparative visual scanning , 1981, Perception & psychophysics.

[45]  H L Kundel,et al.  Interpreting chest radiographs without visual search. , 1975, Radiology.

[46]  T. Crawford,et al.  How do radiologists do it? The influence of experience and training on searching for chest nodules. , 2006 .

[47]  Raymond Bertram,et al.  The Effect of Expertise on Eye Movement Behaviour in Medical Image Perception , 2013, PloS one.

[48]  Bijan Najafi,et al.  A passing glance? Differences in eye tracking and gaze patterns between trainees and experts reading plain film bunion radiographs. , 2015, The Journal of foot and ankle surgery : official publication of the American College of Foot and Ankle Surgeons.

[49]  Harold L. Kundel,et al.  Visual Search in Medical Images , 2000 .

[50]  Paul T. Sowden,et al.  Perceptual learning of the detection of features in X-ray images: a functional role for improvements in adults' visual sensitivity? , 2000, Journal of experimental psychology. Human perception and performance.

[51]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[52]  R. Säljö,et al.  Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains , 2011 .

[53]  B P Wood,et al.  Visual expertise. , 1999, Radiology.

[54]  J. Austin,et al.  Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially resectable lesion evident in retrospect. , 1992, Radiology.

[55]  P. Taylor,et al.  A review of research into the development of radiologic expertise: implications for computer-based training. , 2007, Academic radiology.

[56]  H. Jarodzka,et al.  Expertise under the microscope: processing histopathological slides , 2014, Medical education.

[57]  C. Nodine,et al.  An Analysis of Perceptual and Cognitive Factors in Radiographic Interpretation , 1980, Perception.

[58]  Tamara Miner Haygood,et al.  Radiologists remember mountains better than radiographs, or do they? , 2015, Journal of medical imaging.

[59]  David Manning,et al.  Categories of observer error from eye tracking and AFROC data , 2004, SPIE Medical Imaging.

[60]  H L Kundel,et al.  Nature of expertise in searching mammograms for breast masses , 1996, Medical Imaging.

[61]  Alastair G. Gale,et al.  Diagnostic performance on briefly presented mammographic images , 1995, Medical Imaging.

[62]  Herbert A. Simon,et al.  THE MIND'S EYE IN CHESS , 1988 .

[63]  R. Säljö,et al.  Assessing the Quality of Expertise Differences in the Comprehension of Medical Visualizations , 2013 .

[64]  M. Myles-Worsley,et al.  The influence of expertise on X-ray image processing. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[65]  Claudia Mello-Thoms,et al.  Using gaze-tracking data and mixture distribution analysis to support a holistic model for the detection of cancers on mammograms. , 2008, Academic radiology.

[66]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[67]  W. J. Tuddenham,et al.  Visual search patterns in roentgen diagnosis. , 1961, Radiology.

[68]  Herbert A. Simon,et al.  Templates in Chess Memory: A Mechanism for Recalling Several Boards , 1996, Cognitive Psychology.

[69]  C. Nodine,et al.  The Nature of Expertise in Radiology , 2000 .

[70]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[71]  R. Bird,et al.  Analysis of cancers missed at screening mammography. , 1992, Radiology.

[72]  Robert Rohling,et al.  Evaluating Different Radiology Workstation Interaction Techniques with Radiologists and Laypersons , 2005, Journal of Digital Imaging.

[73]  R G Swensson,et al.  Radiographic interpretation with and without search: visual search aids the recognition of chest pathology. , 1982, Investigative radiology.

[74]  E. Krupinski,et al.  Characterizing the development of visual search expertise in pathology residents viewing whole slide images. , 2013, Human pathology.

[75]  Elizabeth A. Krupinski,et al.  Medical image perception: evaluating the role of experience , 2000, Electronic Imaging.

[76]  T. Saaty,et al.  Why the magic number seven plus or minus two , 2003 .

[77]  C. Mello-Thoms.  Perception of breast cancer: eye-position analysis of mammogram interpretation. , 2003, Academic radiology.

[78]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[79]  Harold L. Kundel,et al.  Modeling visual search during mammogram viewing , 2004, SPIE Medical Imaging.

[80]  Damien Litchfield,et al.  Looking for Cancer: Expertise Related Differences in Searching and Decision Making , 2013 .

[81]  E. Conant,et al.  Holistic component of image perception in mammogram interpretation: gaze-tracking study. , 2007, Radiology.

[82]  William Hendee,et al.  The Handbook of Medical Image Perception and Techniques. , 2010, Medical physics.

[83]  Michelle R. Greene,et al.  Visual search in scenes involves selective and nonselective pathways , 2011, Trends in Cognitive Sciences.

[84]  Guang-Zhong Yang,et al.  Eye Monitoring Applications in Medicine , 2008 .

[85]  H. Rockette.  Multireader ROC Analysis , 2016 .

[86]  Halszka Jarodzka,et al.  Systematic viewing in radiology: seeing more, missing less? , 2016, Advances in health sciences education : theory and practice.

[87]  Trafton Drew,et al.  Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images? , 2013, Radiographics : a review publication of the Radiological Society of North America, Inc.

[88]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[89]  H. Simon,et al.  Perception in chess , 1973 .

[90]  Elizabeth A Krupinski,et al.  Visual search of mammographic images: influence of lesion subtlety. , 2005, Academic radiology.

[91]  Elizabeth A. Krupinski,et al.  Changes in visual search patterns of pathology residents as they gain experience , 2011, Medical Imaging.

[92]  Elizabeth A Krupinski,et al.  Eye tracking helps improve accuracy in radiology , 2006 .

[93]  David Manning,et al.  Eye-tracking AFROC study of the influence of experience and training on chest x-ray interpretation , 2003, SPIE Medical Imaging.

[94]  Claudia Mello-Thoms,et al.  Relating image-based features to mammogram interpretation , 2002, SPIE Medical Imaging.

[95]  E. Krupinski,et al.  Eye-movement study and human performance using telepathology virtual slides: implications for medical education and differences with experience. , 2006, Human pathology.

[96]  Wilson S. Geisler,et al.  Human and optimal eye movement strategies in visual search , 2005 .

[97]  Jeremy M Wolfe,et al.  A half-second glimpse often lets radiologists identify breast cancer cases even when viewing the mammogram of the opposite breast , 2016, Proceedings of the National Academy of Sciences.

[98]  J W Oestmann,et al.  Lung lesions: correlation between viewing time and detection. , 1988, Radiology.

[99]  A. Darzi,et al.  Visual search behaviour in skeletal radiographs: a cross-specialty study. , 2007, Clinical radiology.

[100]  E. Krupinski,et al.  Visual scanning patterns of radiologists searching mammograms. , 1996, Academic radiology.

[101]  Damien Litchfield,et al.  The flash-preview moving windowparadigm: Unpacking visual expertise oneglimpse at a time , 2017 .

[102]  Elizabeth A Krupinski,et al.  Current perspectives in medical image perception , 2010, Attention, perception & psychophysics.

[103]  D. Carmody.  Lung Tumour Identification: Decision-Making and Comparison Scanning , 1984 .

[104]  Sethuraman Panchanathan,et al.  Conscious vs. subconscious perception, as a function of radiological expertise , 2009, 2009 22nd IEEE International Symposium on Computer-Based Medical Systems.

[105]  Gabriel Coscas,et al.  Heidelberg Spectralis Optical Coherence Tomography Angiography: Technical Aspects. , 2016, Developments in ophthalmology.

[106]  H L Kundel,et al.  Visual search patterns and experience with radiological images. , 1972, Radiology.

[107]  H L Kundel,et al.  Global and segmented search for lung nodules of different edge gradients. , 1980, Investigative radiology.

[108]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[109]  Ellen M. Kok,et al.  Looking in the Same Manner but Seeing it Differently: Bottom‐up and Expertise Effects in Radiology , 2012 .

[110]  Christian Lovis,et al.  Use of eye-tracking technology in clinical reasoning: a systematic review , 2015, MIE.

[111]  Harold L. Kundel,et al.  Al Hirschfeld's NINA as a prototype search task for studying perceptual error in radiology , 1997, Medical Imaging.

[112]  Herbert A. Simon,et al.  Five seconds or sixty? Presentation time in expert memory , 2000, Cogn. Sci..

[113]  Paul T. Sowden,et al.  Perceptual learning of the detection of features in X-ray images: a functional role for improvements in adults' visual sensitivity? , 2000, Journal of experimental psychology. Human perception and performance.

[114]  E. Krupinski,et al.  Perceptual skill, radiology expertise, and visual test performance with NINA and WALDO. , 1998, Academic radiology.

[115]  Merim Bilalic,et al.  The Faces in Radiological Images: Fusiform Face Area Supports Radiological Expertise. , 2016, Cerebral cortex.

[116]  Damien Litchfield,et al.  Worth a quick look? Initial scene previews can guide eye movements as a function of domain-specific expertise but can also have unforeseen costs. , 2016, Journal of experimental psychology. Human perception and performance.

[117]  Georgia Tourassi,et al.  Receiver Operating Characteristic Analysis: Basic Concepts and Practical Applications , 2018, The Handbook of Medical Image Perception and Techniques.

[118]  Richard G. Swensson,et al.  A two-stage detection model applied to skilled visual search by radiologists , 1980 .

[119]  Elizabeth A. Krupinski,et al.  Influence of experience on scanning strategies in mammography , 1996, Medical Imaging.

[120]  N. Marwan,et al.  Dynamic Patterns of Expertise: The Case of Orthopedic Medical Diagnosis , 2016, PloS one.