Prediction of human observer performance in a 2-alternative forced choice low-contrast detection task using channelized Hotelling observer: impact of radiation dose and reconstruction algorithms.

PURPOSE Efficient optimization of CT protocols demands a quantitative approach to predicting human observer performance on specific tasks at various scan and reconstruction settings. The goal of this work was to investigate how well a channelized Hotelling observer (CHO) can predict human observer performance on 2-alternative forced choice (2AFC) lesion-detection tasks at various dose levels and two different reconstruction algorithms: a filtered-backprojection (FBP) and an iterative reconstruction (IR) method. METHODS A 35 × 26 cm(2) torso-shaped phantom filled with water was used to simulate an average-sized patient. Three rods with different diameters (small: 3 mm; medium: 5 mm; large: 9 mm) were placed in the center region of the phantom to simulate small, medium, and large lesions. The contrast relative to background was -15 HU at 120 kV. The phantom was scanned 100 times using automatic exposure control each at 60, 120, 240, 360, and 480 quality reference mAs on a 128-slice scanner. After removing the three rods, the water phantom was again scanned 100 times to provide signal-absent background images at the exact same locations. By extracting regions of interest around the three rods and on the signal-absent images, the authors generated 21 2AFC studies. Each 2AFC study had 100 trials, with each trial consisting of a signal-present image and a signal-absent image side-by-side in randomized order. In total, 2100 trials were presented to both the model and human observers. Four medical physicists acted as human observers. For the model observer, the authors used a CHO with Gabor channels, which involves six channel passbands, five orientations, and two phases, leading to a total of 60 channels. The performance predicted by the CHO was compared with that obtained by four medical physicists at each 2AFC study. RESULTS The human and model observers were highly correlated at each dose level for each lesion size for both FBP and IR. The Pearson's product-moment correlation coefficients were 0.986 [95% confidence interval (CI): 0.958-0.996] for FBP and 0.985 (95% CI: 0.863-0.998) for IR. Bland-Altman plots showed excellent agreement for all dose levels and lesions sizes with a mean absolute difference of 1.0% ± 1.1% for FBP and 2.1% ± 3.3% for IR. CONCLUSIONS Human observer performance on a 2AFC lesion detection task in CT with a uniform background can be accurately predicted by a CHO model observer at different radiation dose levels and for both FBP and IR methods.

[1]  A. Burgess,et al.  Human observer detection experiments with mammograms and power-law noise. , 2001, Medical physics.

[2]  Jeffrey H Siewerdsen,et al.  Comparison of model and human observer performance for detection and discrimination tasks using dual-energy x-ray images. , 2008, Medical physics.

[3]  M P Eckstein,et al.  Lesion detection in structured noise. , 1995, Academic radiology.

[4]  J M Boone,et al.  Determination of the presampled MTF in computed tomography. , 2001, Medical physics.

[5]  A. Burgess Statistically defined backgrounds: performance of a modified nonprewhitening observer model. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Thomas L Toth,et al.  Dose reduction and compliance with pediatric CT protocols adapted to patient size, clinical indication, and number of prior studies. , 2009, Radiology.

[7]  Craig K. Abbey,et al.  Stabilized estimates of Hotelling-observer detection performance in patient-structured noise , 1998, Medical Imaging.

[8]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[9]  D. DeLong,et al.  Effect of dose reduction on the detection of mammographic lesions: a mathematical observer model analysis. , 2007, Medical physics.

[10]  Katsuyuki Taguchi,et al.  Achieving routine submillisievert CT scanning: report from the summit on management of radiation dose in CT. , 2012, Radiology.

[11]  Gene Gindi,et al.  The efficiency of the human observer for lesion detection and localization in emission tomography. , 2009, Physics in medicine and biology.

[12]  Kyle J Myers,et al.  Channelized-ideal observer using Laguerre-Gauss channels in detection tasks involving non-Gaussian distributed lumpy backgrounds and a Gaussian signal. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Miguel P Eckstein,et al.  Evaluation of internal noise methods for Hotelling observer models. , 2007, Medical physics.

[14]  Joseph A. O'Sullivan,et al.  Effect of contrast magnitude and resolution metric on noise-resolution tradeoffs in x-ray CT imaging: a comparison of non-quadratic penalized alternating minimization and filtered backprojection algorithms , 2011, Medical Imaging.

[15]  Craig K. Abbey,et al.  Modeling Visual Detection Tasks in Correlated Image Noise with Linear Model Observers , 2000 .

[16]  Adam Wunderlich,et al.  Image covariance and lesion detectability in direct fan-beam x-ray computed tomography , 2008, Physics in medicine and biology.

[17]  Philip F. Judy,et al.  Lesion detection and signal–to–noise ratio in CT images , 1981 .

[18]  D. Jaffray,et al.  A framework for noise-power spectrum analysis of multidimensional images. , 2002, Medical physics.

[19]  Kyle J. Myers,et al.  Model observers for assessment of image quality , 1993 .

[20]  Xiang Li,et al.  Predictive models for observer performance in CT: applications in protocol optimization , 2011, Medical Imaging.

[21]  James H Thrall,et al.  Addressing overutilization in medical imaging. , 2010, Radiology.

[22]  Jeffrey A. Fessler,et al.  Analysis of observer performance in known-location tasks for tomographic image reconstruction , 2006, IEEE Transactions on Medical Imaging.

[23]  Gene Gindi,et al.  Decision strategies that maximize the area under the LROC curve , 2005, IEEE Transactions on Medical Imaging.

[24]  R M Nishikawa,et al.  Task-based assessment of breast tomosynthesis: effect of acquisition parameters and quantum noise. , 2010, Medical physics.

[25]  Ehsan Samei,et al.  Quantitative imaging in breast tomosynthesis and CT: Comparison of detection and estimation task performance. , 2010, Medical physics.

[26]  Harrison H Barrett,et al.  Performance evaluation of a modular gamma camera using a detectability index. , 2003, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[27]  R. F. Wagner,et al.  Application of information theory to the assessment of computed tomography. , 1979, Medical physics.

[28]  Kyle J. Myers,et al.  Foundations of Image Science , 2003, J. Electronic Imaging.

[29]  Harrison H Barrett,et al.  Task-based lens design with application to digital mammography. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[30]  M F McNitt-Gray,et al.  Application of the noise power spectrum in modern diagnostic MDCT: part II. Noise power spectra and signal to noise , 2007, Physics in medicine and biology.

[31]  Jie Yao,et al.  Predicting human performance by a channelized Hotelling observer model , 1992, Optics & Photonics.

[32]  K Stierstorfer,et al.  Performance evaluation of a 64-slice CT system with z-flying focal spot. , 2004, RoFo : Fortschritte auf dem Gebiete der Rontgenstrahlen und der Nuklearmedizin.

[33]  A. Scott,et al.  A simple method for the analysis of clustered binary data. , 1992, Biometrics.

[34]  M P Eckstein,et al.  Visual signal detection in structured backgrounds. IV. Figures of merit for model performance in multiple-alternative forced-choice detection tasks with correlated responses. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[35]  H H Barrett,et al.  Addition of a channel mechanism to the ideal-observer model. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[36]  Miguel P. Eckstein,et al.  Automated optimization of JPEG 2000 encoder options based on model observer performance for detecting variable signals in X-ray coronary angiograms , 2004, IEEE Transactions on Medical Imaging.

[37]  H H Barrett,et al.  Effect of random background inhomogeneity on observer detection performance. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[38]  Gene Gindi,et al.  Collimator optimization in SPECT based on a joint detection and localization task. , 2009, Physics in medicine and biology.

[39]  M. Dylan Tisdall,et al.  Using Human and Model Performance to Compare MRI Reconstructions , 2006, IEEE Transactions on Medical Imaging.

[40]  Donald P Frush,et al.  CT with a computer-simulated dose reduction technique for detection of pediatric nephroureterolithiasis: comparison of standard and reduced radiation doses. , 2009, AJR. American journal of roentgenology.

[41]  H. Barrett,et al.  Effect of noise correlation on detectability of disk signals in medical imaging. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[42]  Joel G Fletcher,et al.  Appropriate patient selection at abdominal dual-energy CT using 80 kV: relationship between patient size, image noise, and image quality. , 2010, Radiology.

[43]  Aldo Badano,et al.  A statistical, task-based evaluation method for three-dimensional x-ray breast imaging systems using variable-background phantoms. , 2010, Medical physics.

[44]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[45]  Matt A. King,et al.  Channelized hotelling and human observer correlation for lesion detection in hepatic SPECT imaging. , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[46]  K. Stierstorfer,et al.  Weighted FBP--a simple approximate 3D FBP algorithm for multislice spiral CT with good dose usage for arbitrary pitch. , 2004, Physics in medicine and biology.

[47]  J H Siewerdsen,et al.  Anatomical background and generalized detectability in tomosynthesis and cone-beam CT. , 2010, Medical physics.

[48]  Ehsan Samei,et al.  Introduction to Grayscale Calibration and Related Aspects of Medical Imaging Grade Liquid Crystal Displays , 2008, Journal of Digital Imaging.

[49]  Shuai Leng,et al.  Correlation between model observer and human observer performance in CT imaging when lesion location is uncertain , 2012, Medical Imaging.

[50]  K. Stierstorfer,et al.  Evaluation of z-axis resolution and image noise for nonconstant velocity spiral CT data reconstructed using a weighted 3D filtered backprojection (WFBP) reconstruction algorithm. , 2010, Medical physics.

[51]  Wojciech Zbijewski,et al.  Cascaded systems analysis of noise and detectability in dual-energy cone-beam CT. , 2012, Medical physics.