Image reconstruction and restoration: overview of common estimation structures and problems

Developments in the theory of image reconstruction and restoration over the past 20 or 30 years are outlined. Particular attention is paid to common estimation structures and to practical problems not properly solved yet. The problem of image reconstruction and restoration is first formulated. Some of the current regularization approaches used to solve the problem are then described. The concepts of a priori information and compound criterion are introduced. A Bayesian interpretation of the regularization techniques is given which clarifies the role of the tuning parameters and indicates how they could be estimated. The practical aspects of computing the solution, first when the hyperparameters are known and second when they must be estimated, are then considered. Conclusions are drawn, and points that still need to be investigated are outlined. >

[1]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[2]  A. Habibi.  Two-dimensional Bayesian estimate of images , 1972 .

[3]  John W. Hilgers.  A Note on Estimating the Optimal Regularization Parameter , 1980 .

[4]  M H Buonocore,et al.  FAST MINIMUM VARIANCE ESTIMATOR FOR LIMITED ANGLE CT IMAGE RECONSTRUCTION , 1981, Medical physics.

[5]  N. Nahi.  Role of recursive estimation in statistical image enhancement , 1972 .

[6]  C. R. Smith,et al.  Maximum-Entropy and Bayesian Methods in Inverse Problems , 1985 .

[7]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  M. Bertero,et al.  On the problems of object restoration and image extrapolation in optics , 1979 .

[9]  Anil K. Jain,et al.  A Semicausal Model for Recursive Filtering of Two-Dimensional Images , 1977, IEEE Transactions on Computers.

[10]  Jae S. Lim,et al.  One-dimensional processing for adaptive image restoration , 1985, IEEE Trans. Acoust. Speech Signal Process..

[11]  J. Woods,et al.  Kalman filtering in two dimensions: Further results , 1981 .

[12]  Leonard M. Silverman,et al.  Nonlinear Restoration of Noisy Images , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  B. Yandell,et al.  Automatic Smoothing of Regression Functions in Generalized Linear Models , 1986 .

[14]  J. Woods,et al.  Estimation and identification of two dimensional images , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[15]  S. Attasi.  Modelling and Recursive Estimation for Double Indexed Sequences , 1976 .

[16]  G. Wahba.  Ill Posed Problems: Numerical and Statistical Methods for Mildly, Moderately and Severely Ill Posed Problems with Noisy Data. , 1980 .

[17]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[18]  John W. Woods,et al.  Image Estimation Using Doubly Stochastic Gaussian Random Field Models , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  T M Cannon,et al.  Comparison of image restoration methods. , 1978, Applied optics.

[20]  Anil K. Jain,et al.  Image Restoration, Modelling, and Reduction of Dimensionality , 1974, IEEE Transactions on Computers.

[21]  John Skilling,et al.  Image restoration by a powerful maximum entropy method , 1982, Comput. Graph. Image Process..

[22]  W. Pratt,et al.  Digital image restoration under a regression model , 1975 .

[23]  Mahmood R. Azimi-Sadjadi,et al.  Two-dimensional block Kalman filtering for image restoration , 1987, IEEE Trans. Acoust. Speech Signal Process..

[24]  J. Skilling,et al.  Deconvolution by maximum entropy, as illustrated by application to the jet of M87 , 1980 .

[25]  Sally L. Wood,et al.  A Fast Implementation of a Minimum Variance Estimator for Computerized Tomography Image Reconstruction , 1981, IEEE Transactions on Biomedical Engineering.

[26]  J. Abramatic,et al.  Non-stationary linear restoration of noisy images , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[27]  C. Helstrom.  Image Restoration by the Method of Least Squares , 1967 .

[28]  A. M. Tekalp,et al.  Comparative study of some recent statistical and set-theoretic methods for image restoration , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[29]  R. Chellappa,et al.  Digital image restoration using spatial interaction models , 1982 .

[30]  Aggelos K. Katsaggelos,et al.  When Ky is in the range of the operator , 2002 .

[31]  JOHN w. WOODS,et al.  Kalman filtering in two dimensions , 1977, IEEE Trans. Inf. Theory.

[32]  Kenneth M. Hanson,et al.  Vayesian and Related Methods in Image Reconstruction from Incomplete Data , 1987 .

[33]  G. Demoment,et al.  Maximum entropy Fourier synthesis with application to diffraction tomography. , 1987, Applied optics.

[34]  R. Kikuchi,et al.  Maximum entropy image restoration. I. The entropy expression , 1977 .

[35]  R. Wilson,et al.  Anisotropic Nonstationary Image Estimation and Its Applications: Part I - Restoration of Noisy Images , 1983, IEEE Transactions on Communications.

[36]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[37]  M. Nashed.  Operator-theoretic and computational approaches to Ill-posed problems with applications to antenna theory , 1981 .

[38]  A. Murat Tekalp,et al.  SET-THEORETIC METHODS FOR IMAGE RESTORATION , 1988 .

[39]  Jan Biemond,et al.  Boundary value problem in image restoration , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[40]  Sibusiso Sibisi,et al.  Two-dimensional reconstructions from one-dimensional data by maximum entropy , 1983, Nature.

[41]  B. R. Hunt,et al.  The Application of Constrained Least Squares Estimation to Image Restoration by Digital Computer , 1973, IEEE Transactions on Computers.

[42]  B. Suresh,et al.  New results in two-dimensional Kalman filtering with applications to image restoration , 1981 .

[43]  S. Twomey,et al.  On the Numerical Solution of Fredholm Integral Equations of the First Kind by the Inversion of the Linear System Produced by Quadrature , 1963, JACM.

[44]  Michael A. Fiddy,et al.  Stable, noniterative object reconstruction from incomplete data using a priori knowledge , 1983 .

[45]  B. P. Agrawal,et al.  Digital restoration of images in the presence of correlated noise , 1976 .

[46]  Jane Cullum,et al.  The effective choice of the smoothing norm in regularization , 1979 .

[47]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[48]  J. Woods.  Markov image modeling , 1976 .

[49]  M. Sezan,et al.  Tomographic Image Reconstruction from Incomplete View Data by Convex Projections and Direct Fourier Inversion , 1984, IEEE Transactions on Medical Imaging.

[50]  Rama Chellappa,et al.  Stochastic relaxation for MAP restoration of gray level images with multiplicative noise , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[51]  Rui J. P. de Figueiredo,et al.  Adaptive nonlinear image restoration by a modified Kalman filtering approach , 1980, ICASSP.

[52]  Michael H. Buonocore,et al.  FAST MINIMUM VARIANCE ESTIMATOR FOR LIMITED ANGLE CT IMAGE RECONSTRUCTION , 1981, Medical physics.

[53]  Stuart Geman,et al.  Stochastic Relaxation Methods for Image Restoration and Expert Systems , 1988 .

[54]  L. Silverman,et al.  Image model representation and line-by-line recursive restoration , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[55]  M. Cannon.  Blind deconvolution of spatially invariant image blurs with phase , 1976 .

[56]  Mario Bertero,et al.  The Stability of Inverse Problems , 1980 .

[57]  Jan Biemond,et al.  A fast Kalman filter for images degraded by both blur and noise , 1982, ICASSP.

[58]  Tomaso Poggio,et al.  Probabilistic Solution of Ill-Posed Problems in Computational Vision , 1987 .

[59]  S. Gull,et al.  Image reconstruction from incomplete and noisy data , 1978, Nature.

[60]  P. Krishnaprasad,et al.  Radon inversion and Kalman reconstructions: A comparison , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[61]  Richard M. Leahy,et al.  An optimal technique for constraint-based image restoration and reconstruction , 1986, IEEE Trans. Acoust. Speech Signal Process..

[62]  J. Hilgers.  Erratum: On the Equivalence of Regularization and Certain Reproducing Kernel Hilbert Space Approaches for Solving First Kind Problems , 1976 .

[63]  B. Roy Frieden,et al.  Restoring with Maximum Entropy, II: Superresolution of Photographs of Diffraction-Blurred Impulses* , 1972 .

[64]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[65]  John W. Woods,et al.  Two-dimensional discrete Markovian fields , 1972, IEEE Trans. Inf. Theory.

[66]  Gabor T. Herman,et al.  A Computer Implementation of a Bayesian Analysis of Image Reconstruction , 1976, Inf. Control..

[67]  G. Wahba,et al.  Generalized Inverses in Reproducing Kernel Spaces: An Approach to Regularization of Linear Operator Equations , 1974 .

[68]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[69]  B. Chalmond.  Image restoration using an estimated Markov model , 1988 .

[70]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[71]  B. Roy Frieden,et al.  Restoring with maximum entropy. III. Poisson sources and backgrounds , 1978 .

[72]  B. Frieden,et al.  Statistical estimates of bounded optical scenes by the method of 'prior probabilities' (Corresp.) , 1973, IEEE Trans. Inf. Theory.

[73]  Bobby R. Hunt,et al.  Improved Methods of Maximum a Posteriori Restoration , 1979, IEEE Transactions on Computers.

[74]  M. Ekstrom,et al.  On the Application of Eigenvector Expansions to Numerical Deconvolution , 1974 .

[75]  J. J. Gerbrands,et al.  A fast Kalman filter for images degraded by both blur and noise , 1983 .

[76]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[77]  B. Hunt.  The inverse problem of radiography , 1970 .

[78]  Thomas S. Huang,et al.  Unified Hilbert space approach to iterative least-squares linear signal restoration , 1983 .

[79]  Arun N. Netravali,et al.  Image Restoration Based on a Subjective Criterion , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[80]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  M. Sezan,et al.  Image Restoration by the Method of Convex Projections: Part 2-Applications and Numerical Results , 1982, IEEE Transactions on Medical Imaging.

[82]  M. E. Davison,et al.  The Ill-Conditioned Nature of the Limited Angle Tomography Problem , 1983 .

[83]  G. Demoment,et al.  Maximum entropy diffraction tomography , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[84]  B. R. Hunt,et al.  Biased estimation for nonparametric identification of linear systems , 1971 .

[85]  R. Roesser.  A discrete state-space model for linear image processing , 1975 .

[86]  S. Gull,et al.  Maximum entropy algorithm applied to image enhancement , 1980 .

[87]  J. Woods.  Markov image modeling , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[88]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.

[89]  S. Dikshit.  A recursive Kalman window approach to image restoration , 1982 .

[90]  Charles L. Byrne,et al.  Image restoration and resolution enhancement , 1983 .

[91]  H. Trussell.  The relationship between image restoration by the maximum a posteriori method and a maximum entropy method , 1980 .

[92]  Zhe Wu,et al.  Multidimensional state-space model Kalman filtering with application to image restoration , 1985, IEEE Trans. Acoust. Speech Signal Process..

[93]  Joel Franklin,et al.  Well-posed stochastic extensions of ill-posed linear problems☆ , 1970 .

[94]  Gabor T. Herman,et al.  A Storage-Efficient Algorithm for Finding the Regularized Solution of a Large, Inconsistent System of Equations , 1980 .

[95]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[96]  D. Titterington.  Common structure of smoothing techniques in statistics , 1985 .

[97]  B. Frieden.  Statistical models for the image restoration problem , 1980 .

[98]  Gabor T. Herman,et al.  Basic methods of tomography and inverse problems , 1987 .

[99]  P. Hall,et al.  Common Structure of Techniques for Choosing Smoothing Parameters in Regression Problems , 1987 .

[100]  Gabor T. Herman,et al.  On the Bayesian Approach to Image Reconstruction , 1979, Inf. Control..

[101]  B. Frieden.  Restoring with maximum likelihood and maximum entropy. , 1972, Journal of the Optical Society of America.

[102]  A. Murat Tekalp,et al.  Identification of image and blur parameters for the restoration of noncausal blurs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[103]  L. Silverman,et al.  Digital restoration of images degraded by general motion blurs , 1977 .

[104]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[105]  Bernard W. Silverman,et al.  A Fast and Efficient Cross-Validation Method for Smoothing Parameter Choice in Spline Regression , 1984 .

[106]  D. Titterington.  General structure of regularization procedures in image reconstruction , 1985 .

[107]  Bobby R. Hunt,et al.  Bayesian Methods in Nonlinear Digital Image Restoration , 1977, IEEE Transactions on Computers.

[108]  John Skilling,et al.  Maximum entropy method in image processing , 1984 .