Approximate Distributions for Maximum Likelihood and Maximum a posteriori Estimates Under a Gaussain Noise Model

The performance of Maximum Likelihood (ML) and Maximum a posteriori (MAP) estimates in nonlinear problems at low data SNR is not well predicted by the Cramer-Rao or other lower bounds on variance. In order to better characterize the distribution of ML and MAP estimates under these conditions, we derive an approximate density for the conditional distribution of such estimates. In one example, this approximate distribution captures the essential features of the distribution of ML and MAP estimates in the presence of Gaussian-distributed noise.

[1]  M F Kijewski,et al.  Maximum-likelihood estimation: a mathematical model for quantitation in nuclear medicine. , 1990, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[2]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Stefan P. Mueller,et al.  Estimation performance at low SNR: predictions of the Barankin bound , 1995, Medical Imaging.

[4]  Jeffrey A. Fessler Mean and variance of implicitly defined biased estimators (such as penalized maximum likelihood): applications to tomography , 1996, IEEE Trans. Image Process..

[5]  Robert Stanton,et al.  Radiological Imaging: The Theory of Image Formation, Detection, and Processing , 1983 .

[6]  H H Barrett,et al.  Objective assessment of image quality: effects of quantum noise and object variability. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[7]  A. Hero,et al.  Cramer-Rao lower bounds for biased image reconstruction , 1993, Proceedings of 36th Midwest Symposium on Circuits and Systems.