Iterative weighted risk estimation for nonlinear image restoration with analysis priors

Image acquisition systems invariably introduce blur, which necessitates the use of deblurring algorithms for image restoration. Restoration techniques involving regularization require appropriate selection of the regularization parameter that controls the quality of the restored result. We focus on the problem of automatic adjustment of this parameter for nonlinear image restoration using analysis-type regularizers such as total variation (TV). For this purpose, we use two variants of Stein's unbiased risk estimate (SURE), Predicted-SURE and Projected-SURE, that are applicable for parameter selection in inverse problems involving Gaussian noise. These estimates require the Jacobian matrix of the restoration algorithm evaluated with respect to the data. We derive analytical expressions to recursively update the desired Jacobian matrix for a fast variant of the iterative reweighted least-squares restoration algorithm that can accommodate a variety of regularization criteria. Our method can also be used to compute a nonlinear version of the generalized cross-validation (NGCV) measure for parameter tuning. We demonstrate using simulations that Predicted-SURE, Projected-SURE, and NGCV-based adjustment of the regularization parameter yields near-MSE-optimal results for image restoration using TV, an analysis-type 1-regularization, and a smooth convex edge-preserving regularizer.

[1]  Jeffrey A. Fessler,et al.  Regularization Parameter Selection for Nonlinear Iterative Image Restoration and MRI Reconstruction Using GCV and SURE-Based Methods , 2012, IEEE Transactions on Image Processing.

[2]  D. Girard,et al.  Fast Computation of Cross-Validated Robust Splines and Other Non-linear Smoothing Splines , 1991, Curves and Surfaces.

[3]  Thierry Blu,et al.  Monte-Carlo Sure: A Black-Box Optimization of Regularization Parameters for General Denoising Algorithms , 2008, IEEE Transactions on Image Processing.

[4]  G. Wahba Smoothing noisy data with spline functions , 1975 .

[5]  M. Hutchinson A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines , 1989 .

[6]  Thierry Blu,et al.  The SURE-LET Approach to Image Denoising , 2007, IEEE Transactions on Image Processing.

[7]  D. M. Titterington,et al.  A Study of Methods of Choosing the Smoothing Parameter in Image Restoration by Regularization , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Gene H. Golub,et al.  Matrix computations , 1983 .

[9]  Yonina C. Eldar Generalized SURE for Exponential Families: Applications to Regularization , 2008, IEEE Transactions on Signal Processing.

[10]  C. Stein Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[11]  Are Hjørungnes,et al.  Complex-Valued Matrix Differentiation: Techniques and Key Results , 2007, IEEE Transactions on Signal Processing.

[12]  Mário A. T. Figueiredo,et al.  Signal restoration with overcomplete wavelet transforms: comparison of analysis and synthesis priors , 2009, Optical Engineering + Applications.

[13]  W. Clem Karl,et al.  3.6 – Regularization in Image Restoration and Reconstruction , 2005 .

[14]  Dimitri Van De Ville,et al.  Nonlocal Means With Dimensionality Reduction and SURE-Based Parameter Selection , 2011, IEEE Transactions on Image Processing.

[15]  Michael Unser,et al.  Recursive risk estimation for non-linear image deconvolution with a wavelet-domain sparsity constraint , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  R. Fair On the Robust Estimation of Econometric Models , 1974 .

[17]  W. Hackbusch Iterative Solution of Large Sparse Systems of Equations , 1993 .

[18]  Yonina C. Eldar,et al.  The Projected GSURE for Automatic Parameter Tuning in Iterative Shrinkage Methods , 2010, Applied and Computational Harmonic Analysis.

[19]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[20]  Jeffrey A. Fessler,et al.  An accelerated iterative reweighted least squares algorithm for compressed sensing MRI , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.