A statistical multiscale framework for Poisson inverse problems

This paper describes a statistical multiscale modeling and analysis framework for linear inverse problems involving Poisson data. The framework itself is founded upon a multiscale analysis associated with recursive partitioning of the underlying intensity, a corresponding multiscale factorization of the likelihood (induced by this analysis), and a choice of prior probability distribution made to match this factorization by modeling the "splits" in the underlying partition. The class of priors used here has the interesting feature that the "noninformative" member yields the traditional maximum-likelihood solution; other choices are made to reflect prior belief as to the smoothness of the unknown intensity. Adopting the expectation-maximization (EM) algorithm for use in computing the maximum a posteriori (MAP) estimate corresponding to our model, we find that our model permits remarkably simple, closed-form expressions for the EM update equations. The behavior of our EM algorithm is examined, and it is shown that convergence to the global MAP estimate can be guaranteed. Applications in emission computed tomography and astronomical energy spectral analysis demonstrate the potential of the new approach.

[1]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[2]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[3]  K. Lange,et al.  EM reconstruction algorithms for emission and transmission tomography. , 1984, Journal of computer assisted tomography.

[4]  Thomas M. Cover,et al.  An algorithm for maximizing expected log investment return , 1984, IEEE Trans. Inf. Theory.

[5]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[6]  F. O’Sullivan A Statistical Perspective on Ill-posed Inverse Problems , 1986 .

[7]  K. Lange,et al.  A Theoretical Study of Some Maximum Likelihood Algorithms for Emission and Transmission Tomography , 1987, IEEE Transactions on Medical Imaging.

[8]  J Llacer,et al.  Feasible images and practical stopping rules for iterative algorithms in emission tomography. , 1989, IEEE transactions on medical imaging.

[9]  T. Hebert,et al.  A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors. , 1989, IEEE transactions on medical imaging.

[10]  P. Green Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[11]  K. Lange Convergence of EM image reconstruction algorithms with Gibbs smoothing. , 1990, IEEE transactions on medical imaging.

[12]  Donald L. Snyder,et al.  Random Point Processes in Time and Space , 1991 .

[13]  Reuven Ramaty,et al.  Solar abundances from gamma-ray spectroscopy : comparisons with energetic particle, photospheric, and coronal abundances , 1991 .

[14]  Michèle Basseville,et al.  Modeling and estimation of multiresolution stochastic processes , 1992, IEEE Trans. Inf. Theory.

[15]  Benjamin M. W. Tsui,et al.  Simulation evaluation of Gibbs prior distributions for use in maximum a posteriori SPECT reconstructions , 1992, IEEE Trans. Medical Imaging.

[16]  Stéphane Mallat,et al.  Introduction to the special issue on wavelet transforms and multiresolution signal analysis , 1992, IEEE Transactions on Information Theory.

[17]  W. Sudderth,et al.  Polya Trees and Random Distributions , 1992 .

[18]  M. McConnell,et al.  Instrument description and performance of the Imaging Gamma-Ray Telescope COMPTEL aboard the Compton Gamma-Ray Observatory , 1993 .

[19]  H. Malcolm Hudson,et al.  Accelerated image reconstruction using ordered subsets of projection data , 1994, IEEE Trans. Medical Imaging.

[20]  Alfred O. Hero,et al.  Space-alternating generalized expectation-maximization algorithm , 1994, IEEE Trans. Signal Process..

[21]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[22]  M. Lavine More Aspects of Polya Tree Distributions for Statistical Modelling , 1992 .

[23]  D. Donoho Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition , 1995 .

[24]  Alfred O. Hero,et al.  Ieee Transactions on Image Processing: to Appear Penalized Maximum-likelihood Image Reconstruction Using Space-alternating Generalized Em Algorithms , 2022 .

[25]  Yoram Bresler,et al.  Multiresolution tomographic reconstruction using wavelets , 1995, IEEE Trans. Image Process..

[26]  Gaofeng Wang,et al.  Solution of inverse problems in image processing by wavelet expansion , 1995, IEEE Trans. Image Process..

[27]  Alvaro R. De Pierro,et al.  A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography , 1995, IEEE Trans. Medical Imaging.

[28]  C. Robert The Bayesian choice : a decision-theoretic motivation , 1996 .

[29]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[30]  Ken D. Sauer,et al.  A unified approach to statistical tomography using coordinate descent optimization , 1996, IEEE Trans. Image Process..

[31]  A. Oppenheim,et al.  Signal processing with fractals: a wavelet-based approach , 1996 .

[32]  Aggelos K. Katsaggelos,et al.  Spatially adaptive wavelet-based multiscale image restoration , 1996, IEEE Trans. Image Process..

[33]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[34]  W. Clem Karl,et al.  A wavelet-based method for multiscale tomographic reconstruction , 1996, IEEE Trans. Medical Imaging.

[35]  E. Kolaczyk A Wavelet Shrinkage Approach to Tomographic Image Reconstruction , 1996 .

[36]  R. Nowak,et al.  A multiscale MAP estimation method for Poisson inverse problems , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[37]  Joseph A. O'Sullivan,et al.  Information-Theoretic Image Formation , 1998, IEEE Trans. Inf. Theory.

[38]  Fionn Murtagh,et al.  Image Processing and Data Analysis - The Multiscale Approach , 1998 .

[39]  B. Silverman,et al.  Wavelet decomposition approaches to statistical inverse problems , 1998 .

[40]  B. Silverman,et al.  Wavelet thresholding via a Bayesian approach , 1998 .

[41]  S. Mallat A wavelet tour of signal processing , 1998 .

[42]  Robert D. Nowak,et al.  Wavelet-domain filtering for photon imaging systems , 1999, IEEE Trans. Image Process..

[43]  E. Kolaczyk Some Observations on the Tractability of Certain Multi-Scale Models , 1999 .

[44]  Walter Willinger,et al.  Introduction to Special Issue on Mutliscale Statistical Signal Analysis and Its Application , 1999, IEEE Trans. Inf. Theory.

[45]  Robert D. Nowak,et al.  Unsupervised progressive parsing of Poisson fields using minimum description length criteria , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[46]  Robert D. Nowak,et al.  Multiscale Modeling and Estimation of Poisson Processes with Application to Photon-Limited Imaging , 1999, IEEE Trans. Inf. Theory.

[47]  Robert Nowak Multiscale hidden Markov models for photon-limited imaging , 1999, Optics & Photonics.

[48]  Robert Nowak,et al.  A Bayesian multiscale framework for SPECT , 1999, 1999 IEEE Nuclear Science Symposium. Conference Record. 1999 Nuclear Science Symposium and Medical Imaging Conference (Cat. No.99CH37019).

[49]  E. Kolaczyk WAVELET SHRINKAGE ESTIMATION OF CERTAIN POISSON INTENSITY SIGNALS USING CORRECTED THRESHOLDS , 1999 .

[50]  Hamid Krim,et al.  Minimax Description Length for Signal Denoising and Optimized Representation , 1999, IEEE Trans. Inf. Theory.

[51]  Robert Nowak,et al.  Multiscale Hidden Markov Models for Bayesian Image Analysis , 1999 .