The perceptual influence of 2D synthesized images on 3D search

For some imaging modalities (e.g., Digital Breast Tomosynthesis, DBT), radiologists are provided, in addition to the 3D image stack, a 2D image known as C-view, a synthesized image from the corresponding 3D slices. An understanding of the functional perceptual interaction between the 2D image and the 3D search remains unexplored. We have yet to elucidate the basic perceptual mechanisms of visual search and attention that drive possible added benefits of incorporating the C-View image in the diagnostic process. We explore how the presence of a 2D synthesized view influences the detectability of signals and eye movements during 3D search in 1/f2.8 filtered noise backgrounds. Six trained observers searched for a microcalcification-like signal and a mass-like signal in 3D volumes (100 slices) with or without an additional 2D synthesized image (2D-S). The 2D-S was obtained by applying a high pass filter and a pixelwise maximum operation across the slices. We found that the detection and localization of small microcalcification-like signals in the 3D images improves when presented together with the 2D-S (p < 0.01). For larger mass-like signals, there was an improvement but not to the same extent as the microcalcification. Additionally, search times are significantly shorter for both signals when the 3D volume is accompanied by the 2D-S versus when used alone (p < 0.05). Eye movement analysis showed significantly fewer search errors in the 2D-S + 3D condition relative to the 3D condition for the microcalcification (p < .001) but not for the mass. The results suggest that a 2D-S allows an observer to efficiently identify suspicious locations, guide the search in 3D, and mitigate detrimental effects of peripheral vision on the detectability of small signals.

[1]  H L Kundel,et al.  Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. , 1978, Investigative radiology.

[2]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[3]  Krista A. Ehinger,et al.  Comparing search patterns in digital breast tomosynthesis and full-field digital mammography: an eye tracking study , 2017, Journal of medical imaging.

[4]  Craig K. Abbey,et al.  Evaluation of search strategies for microcalcifications and masses in 3D images , 2018, Medical Imaging.

[5]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.

[6]  Frank W. Samuelson,et al.  Evaluation of Digital Breast Tomosynthesis as Replacement of Full-Field Digital Mammography Using an In Silico Imaging Trial , 2018, JAMA network open.

[7]  Andrew D. A. Maidment,et al.  OpenVCT: a GPU-accelerated virtual clinical trial pipeline for mammography and digital breast tomosynthesis , 2018, Medical Imaging.

[8]  Per Skaane,et al.  Breast cancer screening with digital breast tomosynthesis , 2016, Breast Cancer.

[9]  Miguel P Eckstein,et al.  The role of extra-foveal processing in 3D imaging , 2017, Medical Imaging.

[10]  Ivan Diaz,et al.  Measurements of the detectability of hepatic hypovascular metastases as a function of retinal eccentricity in CT images , 2012, Medical Imaging.

[11]  Thomas Mertelmeier,et al.  Can Digital Breast Tomosynthesis Replace Full-Field Digital Mammography? A Multireader, Multicase Study of Wide-Angle Tomosynthesis. , 2019, AJR. American journal of roentgenology.

[12]  C Abbey,et al.  Statistical texture synthesis of mammographic images with super-blob lumpy backgrounds. , 1999, Optics express.

[13]  Rongping Zeng,et al.  Classification images for localization performance in ramp-spectrum noise. , 2018, Medical physics.

[14]  Andriy I Bandos,et al.  Comparison of two-dimensional synthesized mammograms versus original digital mammograms alone and in combination with tomosynthesis images. , 2014, Radiology.

[15]  Ehsan Samei,et al.  How does c-view image quality compare with conventional 2D FFDM? , 2016, Medical physics.

[16]  Miguel P Eckstein,et al.  Search for lesions in mammograms: statistical characterization of observer responses. , 2003, Medical physics.

[17]  H L Kundel,et al.  Searching for lung nodules. A comparison of human performance with random and systematic scanning models. , 1987, Investigative radiology.

[18]  Miguel P Eckstein,et al.  Foveated model observers to predict human performance in 3D images , 2017, Medical Imaging.

[19]  Ioannis Sechopoulos,et al.  Measurement of the useful field of view for single slices of different imaging modalities and targets , 2020, Journal of medical imaging.

[20]  Andrew D. A. Maidment,et al.  Virtual clinical trial of lesion detection in digital mammography and digital breast tomosynthesis , 2018, Medical Imaging.

[21]  H H Barrett,et al.  Human- and model-observer performance in ramp-spectrum noise: effects of regularization and object variability. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  Pierre-Edouard Sottas,et al.  Mammographic texture synthesis: second-generation clustered lumpy backgrounds using a genetic algorithm. , 2008, Optics express.

[23]  Andriy I Bandos,et al.  Two-view digital breast tomosynthesis screening with synthetically reconstructed projection images: comparison with digital breast tomosynthesis with full-field digital mammographic images. , 2014, Radiology.

[24]  I. Rentschler,et al.  Peripheral vision and pattern recognition: a review. , 2011, Journal of vision.

[25]  E. Krupinski,et al.  Visual scanning patterns of radiologists searching mammograms. , 1996, Academic radiology.

[26]  Trafton Drew,et al.  What do we know about volumetric medical image interpretation?: a review of the basic science and medical image perception literatures , 2019, Cognitive Research: Principles and Implications.

[27]  Craig K. Abbey,et al.  Observer efficiency in free-localization tasks with correlated noise , 2014, Front. Psychol..

[28]  R. Rosenholtz Capabilities and Limitations of Peripheral Vision. , 2016, Annual review of vision science.

[29]  A. Burgess,et al.  Human observer detection experiments with mammograms and power-law noise. , 2001, Medical physics.

[30]  Craig K. Abbey,et al.  Interactions of lesion detectability and size across single-slice DBT and 3D DBT , 2018, Medical Imaging.

[31]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[32]  J Rovamo,et al.  Temporal Integration and Contrast Sensitivity in Foveal and Peripheral Vision , 1984, Perception.

[33]  Jayantha Katupitiya,et al.  Visual Scanning for , 2003 .

[34]  Miguel P Eckstein,et al.  Learning cue validity through performance feedback. , 2009, Journal of Vision.