Evaluation of search strategies for microcalcifications and masses in 3D images

Medical imaging is quickly evolving towards 3D image modalities such as computed tomography (CT), magnetic resonance imaging (MRI) and digital breast tomosynthesis (DBT). These 3D image modalities add volumetric information but further increase the need for radiologists to search through the image data set. Although much is known about search strategies in 2D images less is known about the functional consequences of different 3D search strategies. We instructed readers to use two different search strategies: drillers had their eye movements restricted to a few regions while they quickly scrolled through the image stack, scanners explored through eye movements the 2D slices. We used real-time eye position monitoring to ensure observers followed the drilling or the scanning strategy while approximately preserving the percentage of the volumetric data covered by the useful field of view. We investigated search for two signals: a simulated microcalcification and a larger simulated mass. Results show an interaction between the search strategy and lesion type. In particular, scanning provided significantly better detectability for microcalcifications at the cost of 5 times more time to search while there was little change in the detectability for the larger simulated masses. Analyses of eye movements support the hypothesis that the effectiveness of a search strategy in 3D imaging arises from the interaction of the fixational sampling of visual information and the signals’ visibility in the visual periphery.

[1]  Harold L Kundel Visual search and lung nodule detection on CT scans. , 2015, Radiology.

[2]  Elizabeth A Krupinski,et al.  The role of perception in imaging: past and future. , 2011, Seminars in nuclear medicine.

[3]  Miguel P Eckstein,et al.  The role of extra-foveal processing in 3D imaging , 2017, Medical Imaging.

[4]  M P Eckstein,et al.  Role of knowledge in human visual temporal integration in spatiotemporal noise. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  E. Krupinski,et al.  Searching for lung nodules. Visual dwell indicates locations of false-positive and false-negative decisions. , 1989, Investigative radiology.

[6]  Wilson S. Geisler,et al.  Simple summation rule for optimal fixation selection in visual search , 2009, Vision Research.

[7]  H L Kundel,et al.  Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. , 1978, Investigative radiology.

[8]  E. Krupinski,et al.  Visual scanning patterns of radiologists searching mammograms. , 1996, Academic radiology.

[9]  Miguel P. Eckstein,et al.  Detection and contrast discrimination of moving signals in uncorrelated Gaussian noise , 1996, Medical Imaging.

[10]  Michael S. Landy,et al.  Suboptimal Choice of Saccade Endpoint in Search with Unequal Payoffs , 2010 .

[11]  H L Kundel,et al.  Peripheral vision, structured noise and film reader error. , 1973, Radiology.

[12]  Howard C Gifford A visual-search model observer for multislice-multiview SPECT images. , 2013, Medical physics.

[13]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[14]  Elizabeth A Krupinski,et al.  Current perspectives in medical image perception , 2010, Attention, perception & psychophysics.

[15]  Craig K. Abbey,et al.  Model observers for signal-known-statistically tasks (SKS) , 2001, SPIE Medical Imaging.

[16]  Martin Tall,et al.  Characterizing search, recognition, and decision in the detection of lung nodules on CT scans: elucidation with eye tracking. , 2015, Radiology.

[17]  Ivan Diaz,et al.  Measurements of the detectability of hepatic hypovascular metastases as a function of retinal eccentricity in CT images , 2012, Medical Imaging.

[18]  Miguel P Eckstein,et al.  Foveated model observers to predict human performance in 3D images , 2017, Medical Imaging.

[19]  H H Barrett,et al.  Human- and model-observer performance in ramp-spectrum noise: effects of regularization and object variability. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Miguel P. Eckstein,et al.  Evolution and Optimality of Similar Neural Mechanisms for Perception and Action during Search , 2010, PLoS Comput. Biol..

[21]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.

[22]  Mini Das,et al.  Visual-search observers for assessing tomographic x-ray image quality. , 2016, Medical physics.

[23]  Miguel P. Eckstein,et al.  Automated optimization of JPEG 2000 encoder options based on model observer performance for detecting variable signals in X-ray coronary angiograms , 2004, IEEE Transactions on Medical Imaging.

[24]  Sheng Zhang,et al.  Optimal and human eye movements to clustered low value cues to increase decision rewards during search , 2015, Vision Research.

[25]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[26]  Miguel P. Eckstein,et al.  Evaluation of JPEG 2000 encoder options: human and model observer detection of variable signals in X-ray coronary angiograms , 2004, IEEE Transactions on Medical Imaging.

[27]  H.H. Barrett,et al.  Model observers for assessment of image quality , 1993, 2002 IEEE Nuclear Science Symposium Conference Record.