A sparse proximal Newton splitting method for constrained image deblurring

It is a challenging task to recover a high quality image from the degraded images. This paper proposes a fast image deblurring algorithm. To deal with the limitations of the proximal Newton splitting scheme, a sparse framework is presented, which characterized by utilizing the sparse pattern of the approximated inverse Hessian matrix and relaxing the original assumption on the constant penalty parameter. The proposed framework provides a common update strategy by exploiting the second derivative information. To alleviate the difficulties introduced by the sub-problem of this framework, an approximate solution to the weighted norm based primal-dual problem is derived and studied. Moreover, its theoretical aspects are also investigated. Compared with the state-of-the-art methods in several numerical experiments, the proposed algorithm demonstrates the performance improvement and efficiency.

[1]  B. R. Hunt,et al.  Digital Image Restoration , 1977 .

[2]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[3]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[4]  Junzhou Huang,et al.  Fast Optimization for Mixture Prior Models , 2010, ECCV.

[5]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[6]  R. H. de Jong,et al.  A new twist. , 1977, JAMA.

[7]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[8]  Ignazio Gallo,et al.  Semi-blind image restoration using a local neural approach , 2008, Neurocomputing.

[9]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[10]  Junfeng Yang,et al.  A Fast Alternating Direction Method for TVL1-L2 Signal Reconstruction From Partial Fourier Data , 2010, IEEE Journal of Selected Topics in Signal Processing.

[11]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[12]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[13]  Dimitri P. Bertsekas,et al.  Convex Optimization Theory , 2009 .

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[16]  Michael A. Saunders,et al.  Proximal Newton-type Methods for Minimizing Convex Objective Functions in Composite Form , 2012, NIPS 2012.

[17]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[18]  Youji Iiguni,et al.  Image restoration using the RBF network with variable regularization parameters , 2003, Neurocomputing.

[19]  Kazuyuki Aihara,et al.  Classifying matrices with a spectral regularization , 2007, ICML '07.

[20]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[21]  R. Nowak,et al.  Fast wavelet-based image deconvolution using the EM algorithm , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[22]  P. L. Combettes,et al.  Solving monotone inclusions via compositions of nonexpansive averaged operators , 2004 .

[23]  Deepa Kundur,et al.  Blind Image Deconvolution , 2001 .

[24]  Zhe Wang,et al.  Image deblurring with filters learned by extreme learning machine , 2011, Neurocomputing.

[25]  Bangti Jin,et al.  A duality-based splitting method for ` 1-TV image restoration with automatic regularization parameter choice ∗ , 2009 .

[26]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[27]  C. Vogel Computational Methods for Inverse Problems , 1987 .

[28]  S. B. Kang,et al.  Image deblurring using inertial measurement sensors , 2010, SIGGRAPH 2010.

[29]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[30]  Truong Q. Nguyen,et al.  An Augmented Lagrangian Method for Total Variation Video Restoration , 2011, IEEE Transactions on Image Processing.

[31]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[32]  R. Dykstra An Algorithm for Restricted Least Squares Regression , 1983 .

[33]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[34]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[35]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[36]  Shiqian Ma,et al.  Fast Multiple-Splitting Algorithms for Convex Optimization , 2009, SIAM J. Optim..

[37]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[38]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.