Model Observers in Medical Imaging Research

Model observers play an important role in the optimization and assessment of imaging devices. In this review paper, we first discuss the basic concepts of model observers, which include the mathematical foundations and psychophysical considerations in designing both optimal observers for optimizing imaging systems and anthropomorphic observers for modeling human observers. Second, we survey a few state-of-the-art computational techniques for estimating model observers and the principles of implementing these techniques. Finally, we review a few applications of model observers in medical imaging research.

[1]  Adam Wunderlich,et al.  Image covariance and lesion detectability in direct fan-beam x-ray computed tomography , 2008, Physics in medicine and biology.

[2]  Jeffrey A. Fessler,et al.  Efficient calculation of resolution and covariance for penalized-likelihood reconstruction in fully 3-D SPECT , 2004, IEEE Transactions on Medical Imaging.

[3]  Ewout Vansteenkiste,et al.  Channelized Hotelling observers for the assessment of volumetric imaging data sets. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Craig K. Abbey,et al.  An Ideal Observer for a Model of X-Ray Imaging in Breast Parenchymal Tissue , 2008, Digital Mammography / IWDM.

[5]  H H Barrett,et al.  Addition of a channel mechanism to the ideal-observer model. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[6]  A. Wunderlich,et al.  On Efficient Assessment of Image-Quality Metrics Based on Linear Model Observers , 2012, IEEE Transactions on Nuclear Science.

[7]  Miguel P Eckstein,et al.  Evaluation of internal noise methods for Hotelling observer models. , 2007, Medical physics.

[8]  C. Beam,et al.  Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. , 1996, Archives of internal medicine.

[9]  W. Geisler.  Ideal Observer Analysis , 2002 .

[10]  N. Obuchowski,et al.  Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests: An anova approach with dependent observations , 1995 .

[11]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[12]  Dev P Chakraborty,et al.  Observer studies involving detection and localization: modeling, analysis, and validation. , 2004, Medical physics.

[13]  Matt A. King,et al.  Channelized hotelling and human observer correlation for lesion detection in hepatic SPECT imaging. , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[14]  Kyle J. Myers,et al.  The Ideal Observer Objective Assessment Metric for Magnetic Resonance Imaging - Application to Signal Detection Tasks , 2011, IPMI.

[15]  D. Kersten,et al.  Illusions, perception and Bayes , 2002, Nature Neuroscience.

[16]  Matthew A. Kupinski,et al.  Ideal-Observer Performance under Signal and Background Uncertainty , 2003, IPMI.

[17]  P. Khurd,et al.  Rapid computation of LROC figures of merit using numerical observers (for SPECT/PET reconstruction) , 2005, IEEE Transactions on Nuclear Science.

[18]  J. Fessler,et al.  Spatial resolution properties of penalized-likelihood image reconstruction: space-invariant tomographs , 1996, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[19]  Harrison H Barrett,et al.  Validating the use of channels to estimate the ideal linear observer. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Yusheng Li,et al.  Noise propagation for iterative penalized-likelihood image reconstruction based on Fisher information , 2011, Physics in medicine and biology.

[21]  J Yorkston,et al.  Task-based modeling and optimization of a cone-beam CT scanner for musculoskeletal imaging. , 2011, Medical physics.

[22]  Gengsheng L. Zeng,et al.  A channelized hotelling trace collimator design method based on reconstruction rather than projections , 2001 .

[23]  J H Siewerdsen,et al.  Anatomical background and generalized detectability in tomosynthesis and cone-beam CT. , 2010, Medical physics.

[24]  Nghia Q. Nguyen,et al.  Optimal beamforming in ultrasound using the ideal observer , 2010, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[25]  Adam Wunderlich,et al.  Estimation of Channelized Hotelling Observer Performance With Known Class Means or Known Difference of Class Means , 2009, IEEE Transactions on Medical Imaging.

[26]  Gene Gindi,et al.  Fast LROC analysis of Bayesian reconstructed emission tomographic images using model observers. , 2005, Physics in medicine and biology.

[27]  Eric Clarkson,et al.  Estimation receiver operating characteristic curve and ideal observers for combined detection/estimation tasks. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Richard M. Leahy,et al.  Resolution and noise properties of MAP reconstruction for fully 3-D PET , 2000, IEEE Transactions on Medical Imaging.

[29]  H.H. Barrett,et al.  Model observers for assessment of image quality , 1993, 2002 IEEE Nuclear Science Symposium Conference Record.

[30]  W. Geisler,et al.  Contributions of ideal observer theory to vision research , 2011, Vision Research.

[31]  Grace J Gang,et al.  Analysis of Fourier-domain task-based detectability index in tomosynthesis and cone-beam CT in relation to human observer performance. , 2011, Medical physics.

[32]  Carole Lartizien,et al.  Volumetric model and human observer comparisons of tumor detection for whole-body positron emission tomography. , 2004, Academic radiology.

[33]  Richard M. Leahy,et al.  Covariance approximation for fast and accurate computation of channelized Hotelling observer statistics , 1999, 1999 IEEE Nuclear Science Symposium. Conference Record. 1999 Nuclear Science Symposium and Medical Imaging Conference (Cat. No.99CH37019).

[34]  Eric Clarkson,et al.  A probabilistic model for the MRMC method, part 1: theoretical development. , 2006, Academic radiology.

[35]  Eric Clarkson,et al.  A probabilistic model for the MRMC method, part 2: validation and applications. , 2006, Academic radiology.

[36]  Richard M. Leahy,et al.  A theoretical study of the contrast recovery and variance of MAP reconstructions from PET data , 1999, IEEE Transactions on Medical Imaging.

[37]  Kyle J. Myers,et al.  Megalopinakophobia: its symptoms and cures , 2001, SPIE Medical Imaging.

[38]  Donald W. Wilson,et al.  Noise properties of the EM algorithm. I. Theory , 1994 .

[39]  Charles L. Byrne,et al.  Noise characterization of block-iterative reconstruction algorithms. I. Theory , 2000, IEEE Transactions on Medical Imaging.

[40]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[41]  K. Berbaum,et al.  Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. , 1992, Investigative radiology.

[42]  Miguel P. Eckstein,et al.  The effect of nonlinear human visual system components on performance of a channelized Hotelling observer in structured backgrounds , 2006, IEEE Transactions on Medical Imaging.

[43]  D. Pelli,et al.  Crowding is unlike ordinary masking: distinguishing feature integration from detection. , 2004, Journal of vision.

[44]  Wilfried Philips,et al.  Volumetric detection tasks with varying complexity: human observer performance , 2012, Medical Imaging.

[45]  B.M.W. Tsui,et al.  A mathematical observer study for the evaluation and optimization of compensation methods for myocardial SPECT using a phantom population that realistically models patient variability , 2004, IEEE Transactions on Nuclear Science.

[46]  Matthew A Kupinski,et al.  Singular value decomposition of pinhole SPECT systems , 2009, Medical Imaging.

[47]  Xin He,et al.  Toward Realistic and Practical Ideal Observer (IO) Estimation for the Optimization of Medical Imaging Systems , 2008, IEEE Transactions on Medical Imaging.

[48]  J. Robson,et al.  Spatial-frequency channels in human vision. , 1971, Journal of the Optical Society of America.

[49]  Emil Y. Sidky,et al.  In-depth analysis of cone-beam CT image reconstruction by ideal observer performance on a detection task , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[50]  Aldo Badano,et al.  A statistical, task-based evaluation method for three-dimensional x-ray breast imaging systems using variable-background phantoms. , 2010, Medical physics.

[51]  W. Geisler,et al.  Bayesian natural selection and the evolution of perceptual systems. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[52]  Brandon Dominic Gallas.  Signal detection in lumpy backgrounds , 2001 .

[53]  Kyle J Myers,et al.  Channelized-ideal observer using Laguerre-Gauss channels in detection tasks involving non-Gaussian distributed lumpy backgrounds and a Gaussian signal. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[54]  Eric C. Frey,et al.  Application of task-based measures of image quality to optimization and evaluation of three-dimensional reconstruction-based compensation methods in myocardial perfusion SPECT , 2002, IEEE Transactions on Medical Imaging.

[55]  Eric Clarkson,et al.  Fisher information and surrogate figures of merit for the task-based assessment of image quality. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[56]  Matthew A Kupinski,et al.  Assessment of a fluorescence-enhanced optical imaging system using the Hotelling observer. , 2006, Optics express.

[57]  A. Wunderlich,et al.  New Theoretical Results on Channelized Hotelling Observer Performance Estimation With Known Difference of Class Means , 2013, IEEE Transactions on Nuclear Science.

[58]  Christophe Deroose,et al.  Performance of MAP Reconstruction for Hot Lesion Detection in Whole-Body PET/CT: An Evaluation With Human and Numerical Observers , 2009, IEEE Transactions on Medical Imaging.

[59]  Matthew A. Kupinski,et al.  Extending the channelized Hotelling observer to account for signal uncertainty and estimation tasks , 2005, SPIE Medical Imaging.

[60]  Yongyi Yang,et al.  Learning a Channelized Observer for Image Quality Assessment , 2009, IEEE Transactions on Medical Imaging.

[61]  Kyle J. Myers,et al.  Incorporating Human Contrast Sensitivity in Model Observers for Detection Tasks , 2009, IEEE Transactions on Medical Imaging.

[62]  Jeffrey A. Fessler.  Mean and variance of implicitly defined biased estimators (such as penalized maximum likelihood): applications to tomography , 1996, IEEE Trans. Image Process..

[63]  H H Barrett,et al.  Human- and model-observer performance in ramp-spectrum noise: effects of regularization and object variability. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[64]  Xin He,et al.  Three-Class ROC Analysis—Toward a General Decision Theoretic Solution , 2010, IEEE Transactions on Medical Imaging.

[65]  H Bal,et al.  Diagnosis of Parkinsonian disorders using a channelized Hotelling observer model: proof of principle. , 2007, Medical physics.

[66]  H. Barrett,et al.  Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[67]  Kyle J. Myers,et al.  Singular Vectors of a Linear Imaging System as Efficient Channels for the Bayesian Ideal Observer , 2009, IEEE Transactions on Medical Imaging.

[68]  Kyle J. Myers,et al.  Partial Least Squares: A Method to Estimate Efficient Channels for the Ideal Observers , 2010, IEEE Transactions on Medical Imaging.

[69]  Dev P Chakraborty,et al.  Recent advances in observer performance methodology: jackknife free-response ROC (JAFROC). , 2005, Radiation protection dosimetry.

[70]  Lorenzo L. Pesce,et al.  On the convexity of ROC curves estimated from radiological test results. , 2010, Academic radiology.

[71]  H. Barrett,et al.  Ideal-observer computation in medical imaging with use of Markov-chain Monte Carlo techniques. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[72]  Eric C Frey,et al.  An investigation of the trade-off between the count level and image quality in myocardial perfusion SPECT using simulated images: the effects of statistical noise and object variability on defect detectability , 2010, Physics in medicine and biology.

[73]  Xiaochuan Pan,et al.  Ideal-observer analysis of lesion detectability in planar, conventional SPECT, and dedicated SPECT scintimammography using effective multi-dimensional smoothing , 1998 .

[74]  Brandon D Gallas,et al.  One-shot estimate of MRMC variance: AUC. , 2006, Academic radiology.

[75]  A E Burgess,et al.  Visual signal detectability with two noise components: anomalous masking effects. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[76]  Jeffrey H. Siewerdsen,et al.  NEQ and task in dual-energy imaging: from cascaded systems analysis to human observer performance , 2008, SPIE Medical Imaging.

[77]  Ronald J. Jaszczak,et al.  Using the Hotelling observer on multi-slice and multi-view simulated SPECT myocardial images , 2001 .

[78]  C. Comtat,et al.  A comparison of planar versus volumetric numerical observers for detection task performance in whole-body PET imaging , 2004, IEEE Transactions on Nuclear Science.