Modified ideal observer model (MIOM) for high‐contrast and high‐spatial resolution CT imaging tasks

Purpose Although a variety of mathematical observer models have been developed to predict human observer performance for low contrast lesion detection tasks, their predictive power for high contrast and high spatial resolution discrimination imaging tasks, including those in CT bone imaging, could be limited. The purpose of this work was to develop a modified observer model that has improved correlation with human observer performance for these tasks. Methods The proposed observer model, referred to as the modified ideal observer model (MIOM), uses a weight function to penalize components in the task function that have less contribution to the actual human observer performance for high contrast and high spatial resolution discrimination tasks. To validate MIOM, both human observer and observer model studies were performed, each using exactly the same CT imaging task [discrimination of a connected component in a high contrast (1000 HU) high spatial resolution bone fracture model (0.3 mm)] and experimental CT image data. For the human observer studies, three physicist observers rated the connectivity of the fracture model using a five‐point Likert scale; for the observer model studies, a total of five observer models, including both conventional models and the proposed MIOM, were used to calculate the discrimination capability of the CT images in resolving the connected component. Images used in the studies encompassed nine different reconstruction kernels. Correlation between human and observer model performance for these kernels were quantified using the Spearman rank correlation coefficient (ρ). After the validation study, an example application of MIOM was presented, in which the observer model was used to select the optimal reconstruction kernel for a High‐Resolution (Hi‐Res, GE Healthcare) CT scan technique. Results The performance of the proposed MIOM correlated well with that of the human observers with a Spearman rank correlation coefficient ρ of 0.88 (P = 0.003). In comparison, the value of ρ was 0.05 (P = 0.904) for the ideal observer, 0.05 (P = 0.904) for the non‐prewhitening observer, −0.18 (P = 0.634) for the non‐prewhitening observer with eye filter and internal noise, and 0.30 (P = 0.427) for the prewhitening observer with eye filter and internal noise. Using the validated MIOM, the optimal reconstruction kernel for the Hi‐Res mode to perform high spatial resolution and high contrast discrimination imaging tasks was determined to be the HD Ultra kernel at the center of the scan field of view (SFOV), or the Lung kernel at the peripheral region of the SFOV. This result was consistent with visual observations of nasal CT images of an in vivo canine subject. Conclusion Compared with other observer models, the proposed modified ideal observer model provides significantly improved correlation with human observers for high contrast and high spatial resolution CT imaging tasks.

[1]  A. E. Burgess,et al.  Vision: High level visual decision efficiencies , 1991 .

[2]  N. Obuchowski,et al.  Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests: An anova approach with dependent observations , 1995 .

[3]  Stephen L Hillis,et al.  Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis. , 2008, Academic radiology.

[4]  Tina Ehtiati,et al.  Task-driven image acquisition and reconstruction in cone-beam CT. , 2015, Physics in medicine and biology.

[5]  Kyle J Myers,et al.  Task-based measures of image quality and their relation to radiation dose and patient risk , 2015, Physics in medicine and biology.

[6]  Grace J Gang,et al.  Analysis of Fourier-domain task-based detectability index in tomosynthesis and cone-beam CT in relation to human observer performance. , 2011, Medical physics.

[7]  Jiang Hsieh,et al.  Reconstruction technique for focal spot wobbling , 1992, Medical Imaging.

[8]  Ehsan Samei,et al.  An Improved Index of Image Quality for Task-based Performance of CT Iterative Reconstruction across Three Commercial Implementations. , 2015, Radiology.

[9]  Adam Wunderlich,et al.  Image covariance and lesion detectability in direct fan-beam x-ray computed tomography , 2008, Physics in medicine and biology.

[10]  A E Burgess Visual signal detection with two-component noise: low-pass spectrum effects. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[12]  R. F. Wagner,et al.  Unified SNR analysis of medical imaging systems , 1985, Physics in medicine and biology.

[13]  J H Siewerdsen,et al.  Optimization of dual-energy imaging systems using generalized NEQ and imaging task. , 2006, Medical physics.

[14]  H.H. Barrett,et al.  Model observers for assessment of image quality , 1993, 2002 IEEE Nuclear Science Symposium Conference Record.

[15]  J Yorkston,et al.  Task-based modeling and optimization of a cone-beam CT scanner for musculoskeletal imaging. , 2011, Medical physics.

[16]  A. Burgess,et al.  Human observer detection experiments with mammograms and power-law noise. , 2001, Medical physics.

[17]  Wei Zhao,et al.  A 3D linear system model for the optimization of dual-energy contrast-enhanced digital breast tomosynthesis , 2011, Medical Imaging.

[18]  Guang-Hong Chen,et al.  Hi-Res scan mode in clinical MDCT systems: Experimental assessment of spatial resolution performance. , 2016, Medical physics.

[19]  S. Hillis A comparison of denominator degrees of freedom methods for multiple observer ROC analysis , 2007, Statistics in medicine.

[20]  Fabio Becce,et al.  Update on the non-prewhitening model observer in computed tomography for the assessment of the adaptive statistical and model-based iterative reconstruction algorithms , 2014, Physics in medicine and biology.

[21]  Xiang Li,et al.  Predictive models for observer performance in CT: applications in protocol optimization , 2011, Medical Imaging.

[22]  Ehsan Samei,et al.  Assessment of the dose reduction potential of a model-based iterative reconstruction algorithm using a task-based performance metrology. , 2014, Medical physics.

[23]  A E Burgess,et al.  Visual signal detection. IV. Observer inconsistency. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[24]  Wei Zhao,et al.  Experimental quantification of lesion detectability in contrast enhanced dual energy digital breast tomosynthesis , 2012, Medical Imaging.

[25]  Wojciech Zbijewski,et al.  Cascaded systems analysis of noise and detectability in dual-energy cone-beam CT. , 2012, Medical physics.

[26]  K. Berbaum,et al.  Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. , 1992, Investigative radiology.

[27]  Guang-Hong Chen,et al.  Model observer and human observer performance studies in differential phase contrast CT , 2013, Medical Imaging.

[28]  Shuai Leng,et al.  Correlation between model observer and human observer performance in CT imaging when lesion location is uncertain , 2012, Medical Imaging.

[29]  Craig K. Abbey,et al.  Model observers for signal-known-statistically tasks (SKS) , 2001, SPIE Medical Imaging.

[30]  Craig K. Abbey,et al.  An Ideal Observer for a Model of X-Ray Imaging in Breast Parenchymal Tissue , 2008, Digital Mammography / IWDM.

[31]  Rebecca Fahrig,et al.  Analysis of lung nodule detectability and anatomical clutter in tomosynthesis imaging of the chest , 2009, Medical Imaging.

[32]  J H Siewerdsen,et al.  Anatomical background and generalized detectability in tomosynthesis and cone-beam CT. , 2010, Medical physics.

[33]  Shuai Leng,et al.  Prediction of human observer performance in a 2-alternative forced choice low-contrast detection task using channelized Hotelling observer: impact of radiation dose and reconstruction algorithms. , 2013, Medical physics.

[34]  Yi Zhang,et al.  Correlation between human and model observer performance for discrimination task in CT , 2014, Physics in medicine and biology.

[35]  Wei Zhao,et al.  Amorphous selenium flat panel detectors for digital mammography: validation of a NPWE model observer with CDMAM observer performance experiments. , 2006, Medical physics.

[36]  Jeffrey H. Siewerdsen,et al.  NEQ and task in dual-energy imaging: from cascaded systems analysis to human observer performance , 2008, SPIE Medical Imaging.

[37]  H T Kukkonen,et al.  A window model for spatial integration in human pattern discrimination. , 1995, Investigative ophthalmology & visual science.

[38]  A E Burgess,et al.  Visual signal detectability with two noise components: anomalous masking effects. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  Srinivasan Vedantham,et al.  Detection in compressed digital mammograms using numerical observers , 2003, SPIE Medical Imaging.

[40]  Nancy A Obuchowski,et al.  A comparison of the Dorfman–Berbaum–Metz and Obuchowski–Rockette methods for receiver operating characteristic (ROC) data , 2005, Statistics in medicine.

[41]  Samuel J. LaRoque,et al.  Evaluation of the channelized Hotelling observer for signal detection in 2D tomographic imaging , 2007, SPIE Medical Imaging.

[42]  R. F. Wagner,et al.  Application of information theory to the assessment of computed tomography. , 1979, Medical physics.

[43]  Guang-Hong Chen,et al.  Correlation between human observer performance and model observer performance in differential phase contrast CT. , 2013, Medical physics.

[44]  R M Nishikawa,et al.  Task-based assessment of breast tomosynthesis: effect of acquisition parameters and quantum noise. , 2010, Medical physics.

[45]  Craig K. Abbey,et al.  Ideal Observer Comparison between Tomographic and Projection x-Ray Images of the Breast , 2010, Digital Mammography / IWDM.

[46]  Matthew A Kupinski,et al.  Assessing image quality and dose reduction of a new x-ray computed tomography iterative reconstruction algorithm using model observers. , 2014, Medical physics.

[47]  J. Solomon,et al.  Characteristic image quality of a third generation dual-source MDCT scanner: Noise, resolution, and detectability. , 2015, Medical physics.