Ringing reduction in image restoration algorithms using a constraint on the inferior bound of the solution

For many image reconstruction (deconvolution) problems, particularly in the field of astrophysics, the "ringing" effect around bright point sources (or more generally in the vicinity of abrupt variations of the intensity) is a prominent artifact. This effect appears when point sources are superimposed on a background and when the reconstruction algorithm do not take into account such background. For astronomical images, difficulties due to this artifact arise during photometric measurements of point sources or in estimating low intensity structures around point sources. We propose a general method allowing to devise maximum-likelihood image restoration algorithms with a general constraint on the inferior bound of the solution, this bound can be different at each point of the signal; ringing phenomena are then reduced. The method is founded on the use of the Kuhn-Tucker first order optimality conditions and can be applied to the minimization of any convex objective function whose definition domain contains the domain of the constraints. We consider Gaussian and Poisson noise processes leading to the minimization of convex objective functions. Moreover, the method is extended to Gamma likelihood as proposed recently by Cao et al. (IEEE Trans. Image, Process. 8(2) (1999) 286). This correspond to the minimization of a quasi-convex objective function: the Itakura-Saito distance. In each case, we develop non-relaxed algorithms, written in a "quasi multiplicative" form, very easy to use, and whose convergence is formally demonstrated in the Gaussian case. The classical EM and ISRA algorithms as well as those by Cao et al. (IEEE Trans. Image, Process. 8(2) (1999) 286) appear as particular cases of the proposed algorithms. The relaxed and accelerated forms of the algorithms are given. In that case, the convergence is ensured, and we show that "economic methods" for the stepsize computation, allow to obtain fast algorithms. This permits to avoid time expensive computations of the "precision" line search methods generally used. Accelerated forms deduced from the method proposed in (Signal processing 81(5) (2001) 945) are exhibited. The algorithms are tested on simulated images and applied to real cases. The properties of the algorithms are shown, in particular their ability to suppress the "ringing" phenomena.

[1]  Rémy Prost,et al.  Iterative constrained deconvulution , 1991, Signal Process..

[2]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[3]  L. B. Lucy,et al.  Optimum strategies for inverse problems in statistical astronomy. , 1994 .

[4]  Alfred O. Hero,et al.  Space-alternating generalized expectation-maximization algorithm , 1994, IEEE Trans. Signal Process..

[5]  Leon B. Lucy Image Restorations of High Photometric Quality , 1994 .

[6]  T. S. Zaccheo,et al.  Iterative maximum-likelihood estimators for positively constrained objects , 1996 .

[7]  D. Titterington On the Iterative Image Space Reconstruction Algorthm for ECT , 1987, IEEE Transactions on Medical Imaging.

[8]  Yu Cao,et al.  Cross Burg entropy maximization and its application to ringing suppression in image reconstruction , 1999, IEEE Trans. Image Process..

[9]  H Lantéri,et al.  A general method to devise maximum-likelihood signal restoration multiplicative algorithms with non-negativity constraints , 2001, Signal Process..

[10]  Florin Popentiu,et al.  Iterative identification and restoration of images , 1993, Comput. Graph..

[11]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[12]  P. L. Combettes,et al.  Foundation of set theoretic estimation , 1993 .

[13]  E. Polak Introduction to linear and nonlinear programming , 1973 .

[14]  M. Bertero Linear Inverse and III-Posed Problems , 1989 .

[15]  Charles L. Byrne,et al.  Iterative image reconstruction algorithms based on cross-entropy minimization , 1992, Optics & Photonics.

[16]  L. Armijo Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .

[17]  A. R. De Pierro,et al.  On the relation between the ISRA and the EM algorithm for positron emission tomography , 1993, IEEE Trans. Medical Imaging.

[18]  Alvaro R. De Pierro OntheConvergence oftheIterative ImageSpace Reconstruction Algorithm forVolumeECT , 1987 .

[19]  P. L. Combettes The foundations of set theoretic estimation , 1993 .

[20]  James H. McClellan,et al.  Convergence of iterative signal reconstruction algorithms , 1981, ICASSP.

[21]  Gérard Thomas,et al.  A positive optimal deconvolution procedure , 1983, ICASSP.

[22]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[23]  I. Csiszár Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[24]  M. E. Daube-Witherspoon,et al.  An iterative image space reconstruction algorithm suitable for volume ECT.IEEE Trans. , 1986 .

[25]  Mario Bertero,et al.  Regularization methods in image restoration: An application to HST images , 1995, Int. J. Imaging Syst. Technol..

[26]  Richard G. Lane Methods for maximum-likelihood deconvolution , 1996 .

[27]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[28]  H. Lantéri,et al.  COMPARISON BETWEEN ISRA AND RLA ALGORITHMS. USE OF A WIENER FILTER BASED STOPPING CRITERION , 1999 .

[29]  Joseph A. O'Sullivan,et al.  Deblurring subject to nonnegativity constraints , 1992, IEEE Trans. Signal Process..

[30]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[31]  S. Levinson,et al.  Image Models (and their Speech Model Cousins) , 1996 .

[32]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[33]  Allen A. Goldstein,et al.  Constructive Real Analysis , 1967 .

[34]  Mario Bertero,et al.  The Stability of Inverse Problems , 1980 .

[35]  Aggelos K. Katsaggelos,et al.  Maximum Likelihood Identification and Restoration of Images Using the Expectation-Maximization Algorithm , 1991 .

[36]  Reginald L. Lagendijk,et al.  Iterative Identification and Restoration of Images (The International Series in Engineering and Computer Science) , 2001 .

[37]  Michael Grüninger,et al.  Introduction , 2002, CACM.

[38]  J. F. Traub Iterative Methods for the Solutions of Equations , 1965 .

[39]  Mario Bertero,et al.  Inverse scattering problems in optics , 1980 .

[40]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[41]  F. B. Hildebrand,et al.  Introduction To Numerical Analysis , 1957 .

[42]  Claude Aime,et al.  ISRA and RL Algorithms Used for Deconvolution of AO and HST Images , 1999 .

[43]  Reginald L. Lagendijk,et al.  Iterative Image Restoration , 1991 .

[44]  P. P. B. Eggermont,et al.  Multiplicative iterative algorithms for convex programming , 1990 .

[45]  Gabor T. Herman,et al.  Maximum a Posteriori Image Reconstruction from Projections , 1996 .

[46]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[47]  Ryan J. Murphy,et al.  Deblurring subject to nonnegativity constraints when known functions are present with application to object-constrained computerized tomography , 2001, IEEE Transactions on Medical Imaging.