Analysis of observer performance in known-location tasks for tomographic image reconstruction

We consider the task of detecting a statistically varying signal of known location on a statistically varying background in a reconstructed tomographic image. We analyze the performance of linear observer models in this task. We show that, if one chooses a suitable reconstruction method, a broad family of linear observers can exactly achieve the optimal detection performance attainable with any combination of a linear observer and linear reconstructor. This conclusion encompasses several well-known observer models from the literature, including models with a frequency-selective channel mechanism and certain types of internal noise. Interestingly, the "optimal" reconstruction methods are unregularized and in some cases quite unconventional. These results suggest that, for the purposes of designing regularized reconstruction methods that optimize lesion detectability, known-location tasks are of limited use.

[1]  H H Barrett,et al.  Addition of a channel mechanism to the ideal-observer model. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[2]  P. Khurd,et al.  Rapid computation of LROC figures of merit using numerical observers (for SPECT/PET reconstruction) , 2005, IEEE Transactions on Nuclear Science.

[3]  Anastasia Yendiki,et al.  Analysis of signal detectability in statistically reconstructed tomographic images. , 2005 .

[4]  Kyle J. Myers,et al.  Ideal Observer Models of Visual Signal Detection , 2000 .

[5]  H H Barrett,et al.  Effect of random background inhomogeneity on observer detection performance. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[6]  H.C. Gifford,et al.  Evaluation of multiclass model observers in PET LROC studies , 2004, IEEE Symposium Conference Record Nuclear Science 2004..

[7]  S. R. Searle,et al.  On Deriving the Inverse of a Sum of Matrices , 1981 .

[8]  SIDNEY K. EDELMAN,et al.  Attenuation , 1988, Atlas of Ultrasound-Guided Regional Anesthesia.

[9]  Harrison H Barrett,et al.  Validating the use of channels to estimate the ideal linear observer. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  R. Adler On excursion sets, tube formulas and maxima of random fields , 2000 .

[11]  R. Swensson Unified measurement of observer performance in detecting and localizing target objects on images. , 1996, Medical physics.

[12]  K. Worsley Detecting activation in fMRI data , 2003, Statistical methods in medical research.

[13]  H H Barrett,et al.  Objective assessment of image quality: effects of quantum noise and object variability. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[14]  J. Qi Comparison of statistical reconstructions with isotropic and anisotropic resolution , 2004, IEEE Symposium Conference Record Nuclear Science 2004..

[15]  R. F. Wagner,et al.  Efficiency of human visual signal discrimination. , 1981, Science.

[16]  J.A. Fessler Analytical approach to regularization design for isotropic spatial resolution , 2003, 2003 IEEE Nuclear Science Symposium. Conference Record (IEEE Cat. No.03CH37515).

[17]  Craig K. Abbey,et al.  Maximum-likelihood and maximum-a-posteriori estimates of human-observer templates , 2001, SPIE Medical Imaging.

[18]  Jannick P. Rolland,et al.  Linear discriminants and image quality , 1991, Image Vis. Comput..

[19]  M. S. Chesters,et al.  Human visual perception and ROC methodology in medical imaging. , 1992, Physics in medicine and biology.

[20]  R. F. Wagner,et al.  Aperture optimization for emission imaging: effect of a spatially varying background. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[21]  Jinyi Qi,et al.  Penalized maximum-likelihood image reconstruction for lesion detection. , 2006, Physics in medicine and biology.

[22]  Matt A. King,et al.  Channelized hotelling and human observer correlation for lesion detection in hepatic SPECT imaging. , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[23]  J. Schmee Matrices with Applications in Statistics , 1982 .

[24]  Yuxiang Xing,et al.  Rapid calculation of detectability in Bayesian single photon emission computed tomography. , 2003, Physics in medicine and biology.

[25]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[26]  Donald W. Wilson,et al.  Noise properties of the EM algorithm. I. Theory , 1994 .

[27]  Jinyi Qi,et al.  Fast approach to evaluate MAP reconstruction for lesion detection and localization , 2004, SPIE Medical Imaging.

[28]  Richard M. Leahy,et al.  A theoretical study of the contrast recovery and variance of MAP reconstructions with applications to the selection of smoothing parameters , 1998, 1998 IEEE Nuclear Science Symposium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No.98CH36255).

[29]  Jeffrey A. Fessler,et al.  Spatial resolution properties of penalized-likelihood image reconstruction: space-invariant tomographs , 1996, IEEE Trans. Image Process..

[30]  D. Siegmund,et al.  Testing for a Signal with Unknown Location and Scale in a Stationary Gaussian Random Field , 1995 .

[31]  David G. Stork,et al.  Pattern Classification , 1973 .

[32]  Jeffrey A. Fessler,et al.  Conjugate-gradient preconditioning methods for shift-variant PET image reconstruction , 1999, IEEE Trans. Image Process..

[33]  Michael A. King,et al.  Comparison of human- and model-observer LROC studies , 2003, SPIE Medical Imaging.

[34]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[35]  A E Burgess,et al.  Visual signal detection. IV. Observer inconsistency. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[36]  Charles E. Metz,et al.  On The Multiplex Advantage Of Coded Source/Aperture Photon Imaging , 1981, Other Conferences.

[37]  Jinyi Qi Analysis of lesion detectability in Bayesian emission reconstruction with nonstationary object variability , 2004, IEEE Transactions on Medical Imaging.

[38]  A. Yendiki,et al.  Analysis of observer performance in detecting signals with location uncertainty for regularized tomographic image reconstruction , 2004, IEEE Symposium Conference Record Nuclear Science 2004..

[39]  K Doi,et al.  A comparison of physical image quality indices and observer performance in the radiographic detection of nylon beads. , 1984, Physics in medicine and biology.

[40]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[41]  Craig K. Abbey,et al.  Optimal shifted estimates of human-observer templates in two-alternative forced-choice experiments , 2002, IEEE Transactions on Medical Imaging.

[42]  Jeffrey A. Fessler,et al.  Analytical approach to channelized Hotelling observer performance for regularized tomographic image reconstruction , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[43]  F. Graybill,et al.  Matrices with Applications in Statistics. , 1984 .

[44]  Gene Gindi,et al.  LROC model observers for emission tomographic reconstruction , 2004, SPIE Medical Imaging.

[45]  Richard M. Leahy,et al.  A theoretical study of the contrast recovery and variance of MAP reconstructions from PET data , 1999, IEEE Transactions on Medical Imaging.

[46]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[47]  C. Vogel Non-convergence of the L-curve regularization parameter selection method , 1996 .

[48]  Dianne P. O'Leary,et al.  The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems , 1993, SIAM J. Sci. Comput..

[49]  Charles R. Harrell,et al.  High resolution anthropomorphic phantom for Monte Carlo analysis of internal radiation sources , 1990, [1990] Proceedings. Third Annual IEEE Symposium on Computer-Based Medical Systems.

[50]  Jeffrey A. Fessler,et al.  Channelized hotelling observer performance for penalized-likelihood image reconstruction , 2002, 2002 IEEE Nuclear Science Symposium Conference Record.

[51]  Ronald H. Huesman,et al.  Theoretical study of lesion detectability of MAP reconstruction using computer observers , 2001, IEEE Transactions on Medical Imaging.

[52]  Richard M. Leahy,et al.  Covariance approximation for fast and accurate computation of channelized Hotelling observer statistics , 1999, 1999 IEEE Nuclear Science Symposium. Conference Record. 1999 Nuclear Science Symposium and Medical Imaging Conference (Cat. No.99CH37019).

[53]  Eric C Frey,et al.  Optimum compensation method and filter cutoff frequency in myocardial SPECT: a human observer study. , 2002, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[54]  L B Lusted,et al.  Signal detectability and medical decision-making. , 1971, Science.

[55]  M.A. King,et al.  A comparison of human observer LROC and numerical observer ROC for tumor detection in SPECT images , 1998, 1998 IEEE Nuclear Science Symposium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No.98CH36255).

[56]  Michael A. King,et al.  CHAPTER 22 – Attenuation, Scatter, and Spatial Resolution Compensation in SPECT , 2004 .

[57]  D. Lalush,et al.  Comparison of Hotelling observer models and human observers in defect detection from myocardial SPECT imaging , 1999 .

[58]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[59]  Jeffrey A. Fessler Mean and variance of implicitly defined biased estimators (such as penalized maximum likelihood): applications to tomography , 1996, IEEE Trans. Image Process..

[60]  H H Barrett,et al.  Human- and model-observer performance in ramp-spectrum noise: effects of regularization and object variability. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[61]  Jeffrey A. Fessler,et al.  Regularization for uniform spatial resolution properties in penalized-likelihood image reconstruction , 2000, IEEE Transactions on Medical Imaging.

[62]  Richard M. Leahy,et al.  Resolution and noise properties of MAP reconstruction for fully 3-D PET , 2000, IEEE Transactions on Medical Imaging.

[63]  H.H. Barrett,et al.  Model observers for assessment of image quality , 1993, 2002 IEEE Nuclear Science Symposium Conference Record.