CONSTRAINED MINIMIZATION ALGORITHMS

In this paper, we consider the inverse problem of restoring an unknown signal or image, knowing the transformation suffered by the unknowns. More specifically we deal with transformations described by a linear model linking the unknown signal to an unnoisy version of the data. The measured data are generally corrupted by noise. This aspect of the problem is presented in the introduction for general models. In Section 2, we introduce the linear models, and some examples of linear inverse problems are presented. The specificities of the inverse problems are briefly mentionned and shown on a simple example. In Section 3, we give some information on classical distances or divergences. Indeed, an inverse problem is generally solved by minimizing a discrepancy function (divergence or distance) between the measured data and the model (here linear) of such data. Section 4 deals with the likelihood maximization and with their links with divergences minimization. The physical constraints on the solution are indicated and the Split Gradient Method (SGM) is detailed in Section 5. A constraint on the inferior bound of the solution is introduced at first; the positivity constraint is a particular case of such a constraint. We show how to obtain strictly, the multiplicative form of the algorithms. In a second step, the so- called flux constraint is introduced, and a complete algorithmic form is given. In Section 6 we give some brief information on acceleration method of such algorithms. A conclusion is given in Section 7.

[1]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..

[2]  S. Amari,et al.  Quasi‐Newton Algorithms for Nonnegative Matrix Factorization , 2009 .

[3]  S. Amari,et al.  Nonnegative Matrix and Tensor Factorizations - Applications to Exploratory Multi-way Data Analysis and Blind Source Separation , 2009 .

[4]  I. J. Taneja On Mean Divergence Measures , 2005, math/0501298.

[5]  H. Lantéri,et al.  Ringing reduction in image restoration algorithms using a constraint on the inferior bound of the solution , 2002, Signal Process..

[6]  H. Lantéri,et al.  Penalized maximum likelihood image restoration with positivity constraints:multiplicative algorithms , 2002 .

[7]  H Lantéri,et al.  A general method to devise maximum-likelihood signal restoration multiplicative algorithms with non-negativity constraints , 2001, Signal Process..

[8]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[9]  Wolfgang Osten,et al.  Introduction to Inverse Problems in Imaging , 1999 .

[10]  D S Biggs,et al.  Acceleration of iterative image restoration algorithms. , 1997, Applied optics.

[11]  M. Basseville Information : entropies, divergences et moyennes , 1996 .

[12]  Richard G. Lane,et al.  Blind deconvolution of speckle images , 1992 .

[13]  I. Csiszár Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[14]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[15]  J. C. Dainty,et al.  Iterative blind deconvolution method and its applications , 1988 .

[16]  W. Streifer,et al.  Weak coupling of parallel waveguides: erratum. , 1988, Optics letters.

[17]  C. R. Rao,et al.  On the convexity of some divergence measures based on entropy functions , 1982, IEEE Trans. Inf. Theory.

[18]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[19]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[20]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[21]  Raul Poler,et al.  Non-Linear Programming , 2014 .

[22]  Yonina C. Eldar,et al.  Convex Optimization in Signal Processing and Communications , 2009 .

[23]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[24]  M. Bertero Linear Inverse and III-Posed Problems , 1989 .

[25]  Daniel Taupin,et al.  Probabilities data reduction and error analysis in the physical sciences/ by Daniel Taupin , 1988 .

[26]  M. Daube-Witherspoon,et al.  An Iterative Image Space Reconstruction Algorthm Suitable for Volume ECT , 1986, IEEE Transactions on Medical Imaging.

[27]  Harry C. Andrews,et al.  Digital image restauration , 1977 .

[28]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[29]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .