Fine-Granularity and Spatially-Adaptive Regularization for Projection-Based Image Deblurring

This paper studies two classes of regularization strategies to achieve an improved tradeoff between image recovery and noise suppression in projection-based image deblurring. The first is based on a simple fact that r-times Landweber iteration leads to a fixed level of regularization, which allows us to achieve fine-granularity control of projection-based iterative deblurring by varying the value r. The regularization behavior is explained by using the theory of Lagrangian multiplier for variational schemes. The second class of regularization strategy is based on the observation that various regularized filters can be viewed as nonexpansive mappings in the metric space. A deeper understanding about different regularization filters can be gained by probing into their asymptotic behavior-the fixed point of nonexpansive mappings. By making an analogy to the states of matter in statistical physics, we can observe that different image structures (smooth regions, regular edges and textures) correspond to different fixed points of nonexpansive mappings when the temperature(regularization) parameter varies. Such an analogy motivates us to propose a deterministic annealing based approach toward spatial adaptation in projection-based image deblurring. Significant performance improvements over the current state-of-the-art schemes have been observed in our experiments, which substantiates the effectiveness of the proposed regularization strategies.

[1]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[2]  Onur G. Guleryuz,et al.  Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part I: theory , 2006, IEEE Transactions on Image Processing.

[3]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[4]  Nikolas P. Galatsanos,et al.  Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation , 1992, IEEE Trans. Image Process..

[5]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[7]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..

[8]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[9]  José M. Bioucas-Dias,et al.  Total Variation-Based Image Deconvolution: a Majorization-Minimization Approach , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[10]  Jelena Kovacevic,et al.  Reproducible research in signal processing , 2009, IEEE Signal Process. Mag..

[11]  I. Ekeland On the variational principle , 1974 .

[12]  Karen O. Egiazarian,et al.  Image restoration by sparse 3D transform-domain collaborative filtering , 2008, Electronic Imaging.

[13]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[14]  Claudio Estatico,et al.  Improvement of Space-Invariant Image Deblurring by Preconditioned Landweber Iterations , 2008, SIAM J. Sci. Comput..

[15]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[16]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[17]  S. Gull,et al.  Image reconstruction from incomplete and noisy data , 1978, Nature.

[18]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[20]  Henry Stark,et al.  Image restoration by the method of generalized projections with application to restoration from magnitude , 1984, ICASSP.

[21]  Aggelos K. Katsaggelos,et al.  Parameter Estimation in TV Image Restoration Using Variational Distribution Approximation , 2008, IEEE Transactions on Image Processing.

[22]  Reginald L. Lagendijk,et al.  Regularized iterative image restoration with ringing reduction , 1988, IEEE Trans. Acoust. Speech Signal Process..

[23]  L. Landweber An iteration formula for Fredholm integral equations of the first kind , 1951 .

[24]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[25]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[26]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[27]  Richard G. Baraniuk,et al.  ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems , 2004, IEEE Transactions on Signal Processing.

[28]  Efe A. Ok Real analysis with economic applications , 2007 .

[29]  F. Browder Normal solvability for nonlinear mappings into Banach spaces , 1971 .

[30]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[31]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[32]  L. Vese,et al.  A Variational Method in Image Recovery , 1997 .

[33]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[34]  Onur G. Guleryuz,et al.  Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part II: adaptive algorithms , 2006, IEEE Transactions on Image Processing.

[35]  Dante C. Youla,et al.  Generalized Image Restoration by the Method of Alternating Orthogonal Projections , 1978 .

[36]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[37]  H. Trussell,et al.  The feasible solution in signal restoration , 1984 .

[38]  Thomas Brox,et al.  On the Equivalence of Soft Wavelet Shrinkage, Total Variation Diffusion, Total Variation Regularization, and SIDEs , 2004, SIAM J. Numer. Anal..

[39]  Aggelos K. Katsaggelos,et al.  Spatially adaptive wavelet-based multiscale image restoration , 1996, IEEE Trans. Image Process..

[40]  J. Caristi,et al.  Fixed point theorems for mapping satisfying inwardness conditions , 1976 .

[41]  M. Bertero,et al.  Projected Landweber method and preconditioning , 1997 .

[42]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[43]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[44]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[45]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[46]  B. Kaltenbacher Some Newton-type methods for the regularization of nonlinear ill-posed problems , 1997 .

[47]  H. Trussell,et al.  The Landweber iteration and projection onto convex sets , 1985, IEEE Trans. Acoust. Speech Signal Process..

[48]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[49]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[50]  Xavier Bresson,et al.  A Short Note for Nonlocal TV Minimization , 2009 .

[51]  M. Sezan,et al.  Image Restoration by the Method of Convex Projections: Part 2-Applications and Numerical Results , 1982, IEEE Transactions on Medical Imaging.

[52]  Xin Li,et al.  Collective sensing: a fixed-point approach in the metric space , 2010, Visual Communications and Image Processing.

[53]  D. Lorenz,et al.  Solving variational problems in image processing via projections – a common view on TV denoising and wavelet shrinkage , 2007 .

[54]  David Yang Gao,et al.  NONCONVEX MINIMIZATION PROBLEMS , 2007 .

[55]  R. Mersereau,et al.  Iterative methods for image deblurring , 1990 .

[56]  Javier Portilla,et al.  Non-convex sparse optimization through deterministic annealing and applications , 2008, 2008 15th IEEE International Conference on Image Processing.

[57]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.