A foveated channelized Hotelling search model predicts dissociations in human performance in 2D and 3D images

We developed a foveated search model based on the channelized Hotelling observer (FCHO) that processes each image in parallel with Gabor channels which center frequencies decrease with retinal eccentricity (distance away from the fovea). The FCHO model is based on how radiologists read 3D volumes by scrolling through 2D slices. The model includes a search component that explores the image by making eye movements guided by peripheral processing and a slice scroll component that changes the current slice for the 3D images. We designed an experiment consisting of a free search in 2D and 3D noise filtered with power-law statistics matching mammograms. Two different targets were embedded in this background: one resembling a microcalcification and another one resembling a mass. Unlike traditional model observers (chanellized Hotelling and non-prewhitening matched filter with an eye filter), performance for the FCHO search model for both 2D and 3D search tasks showed similar dissociations as that of human observers. Detectability of a microcalcification-like target was significantly higher than for a mass-like target in 2D search but comparable or lower in 3D search. Together, our results suggest that 3D search tasks will require more computationally complex 3D search models that take into account the foveated properties of the visual system and eye movements to predict human observer performance in clinically relevant tasks.

[1]  A E Burgess,et al.  Visual signal detection. IV. Observer inconsistency. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[2]  Sheng Zhang,et al.  Optimal and human eye movements to clustered low value cues to increase decision rewards during search , 2015, Vision Research.

[3]  E. Krupinski,et al.  Visual scanning patterns of radiologists searching mammograms. , 1996, Academic radiology.

[4]  A. Burgess,et al.  Human observer detection experiments with mammograms and power-law noise. , 2001, Medical physics.

[5]  Miguel P. Eckstein,et al.  Automated optimization of JPEG 2000 encoder options based on model observer performance for detecting variable signals in X-ray coronary angiograms , 2004, IEEE Transactions on Medical Imaging.

[6]  Martin Tall,et al.  Characterizing search, recognition, and decision in the detection of lung nodules on CT scans: elucidation with eye tracking. , 2015, Radiology.

[7]  Harold L. Kundel,et al.  Perception Errors in Chest Radiography , 1989 .

[8]  Miguel P. Eckstein,et al.  Evaluation of JPEG 2000 encoder options: human and model observer detection of variable signals in X-ray coronary angiograms , 2004, IEEE Transactions on Medical Imaging.

[9]  E. Halpern,et al.  Assessing radiologist performance using combined digital mammography and breast tomosynthesis compared with digital mammography alone: results of a multicenter, multireader trial. , 2013, Radiology.

[10]  Trafton Drew,et al.  Scanners and drillers: characterizing expert visual search through volumetric images. , 2013, Journal of vision.

[11]  Ewout Vansteenkiste,et al.  Channelized Hotelling observers for the assessment of volumetric imaging data sets. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[13]  Craig K. Abbey,et al.  Interactions of lesion detectability and size across single-slice DBT and 3D DBT , 2018, Medical Imaging.

[14]  Linda G. Shapiro,et al.  Characterizing Diagnostic Search Patterns in Digital Breast Pathology: Scanners and Drillers , 2018, Journal of Digital Imaging.

[15]  Charles Audet,et al.  Mesh Adaptive Direct Search Algorithms for Constrained Optimization , 2006, SIAM J. Optim..

[16]  H H Barrett,et al.  Human- and model-observer performance in ramp-spectrum noise: effects of regularization and object variability. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Miguel P. Eckstein,et al.  Object detection through search with a foveated visual system , 2014, PLoS Comput. Biol..

[18]  Miguel P Eckstein,et al.  Evaluation of internal noise methods for Hotelling observer models. , 2007, Medical physics.

[19]  T. Cohn,et al.  Detectability of a luminance increment: effect of spatial uncertainty. , 1974, Journal of the Optical Society of America.