Single-image blind deblurring with hybrid sparsity regularization

Single-image blind deblurring could be considered as an important preprocessing step in imaging information fusion. Its purpose is to simultaneously estimate blur kernel and latent sharp image from only one observed blurred image. Blind deblurring has been attracting increasing attention in the fields of image processing, computer vision, computational photography, etc. However, it is a typically ill-posed inverse problem, which requires regularization methods to guarantee stable image restoration results. We first proposed to robustly estimate the blur kernels by exploiting non-convex sparsity constraints on image gradients and blur kernels. The corresponding combined non-convex regularization term has the capacity of enhancing estimation accuracy. To guarantee the high-quality non-blind deblurring with estimated blur kernels, the hybrid non-convex first- and second-order TV regularizer was then introduced to stabilize the final image restoration process. The hybrid non-convex regularizer is able to achieve a good balance between sharp edges preservation and undesirable artifacts suppression. The resulting non-convex minimization problems related to blur kernel estimation and non-blind deblurring were handled using efficient numerical optimization algorithms in this paper. Numerous experiments on both synthetic and realistic images have demonstrated the good performance of the proposed blind deblurring method.

[1]  Michael Unser,et al.  Hessian-Based Norm Regularization for Image Restoration With Biomedical Applications , 2012, IEEE Transactions on Image Processing.

[2]  Li Bai,et al.  An edge-weighted second order variational model for image decomposition , 2016, Digit. Signal Process..

[3]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[4]  Serena Morigi,et al.  Constrained TV p -ℓ 2 Model for Image Restoration. , 2016 .

[5]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[6]  Hyenkyun Woo,et al.  Non-convex hybrid total variation for image denoising , 2013, J. Vis. Commun. Image Represent..

[7]  Naixue Xiong,et al.  Effective Alternating Direction Optimization Methods for Sparsity-Constrained Blind Image Deblurring , 2017, Sensors.

[8]  Ivan W. Selesnick,et al.  Artifact-Free Wavelet Denoising: Non-convex Sparse Regularization, Convex Optimization , 2015, IEEE Signal Processing Letters.

[9]  C. N. hyndhavi,et al.  Group-sparse signal denoising : Non-convex Regularization , Convex Optimization , 2018 .

[10]  Roland T. Chin,et al.  Iterative Wiener filters for image restoration , 1991, IEEE Trans. Signal Process..

[11]  Naixue Xiong,et al.  Constrained Nonconvex Hybrid Variational Model for Edge-Preserving Image Restoration , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[13]  Deepa Kundur,et al.  Blind Image Deconvolution , 2001 .

[14]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Chao Wang,et al.  Enhancing Bayesian Estimators for Removing Camera Shake , 2013, Comput. Graph. Forum.

[16]  Wanquan Liu,et al.  Fast algorithm for color texture image inpainting using the non-local CTV model , 2015, J. Glob. Optim..

[17]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[18]  Shuaiqi Liu,et al.  Total variation image restoration using hyper-Laplacian prior with overlapping group sparsity , 2016, Signal Process..

[19]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[20]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[21]  Rayan Saab,et al.  Sparse Recovery by Non-convex Optimization -- Instance Optimality , 2008, ArXiv.

[22]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[23]  Li Bai,et al.  Implementation of high‐order variational models made easy for image processing , 2016 .

[24]  Naixue Xiong,et al.  Hybrid Regularized Blur Kernel Estimation for Single-Image Blind Deconvolution , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Ivan W. Selesnick,et al.  Group-Sparse Signal Denoising: Non-Convex Regularization, Convex Optimization , 2013, IEEE Transactions on Signal Processing.

[26]  Daniele Perrone,et al.  A Clearer Picture of Total Variation Blind Deconvolution , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[28]  Frédo Durand,et al.  Understanding Blind Deconvolution Algorithms , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ryan Wen Liu,et al.  A predictor-corrector iterated Tikhonov regularization for linear ill-posed inverse problems , 2013, Appl. Math. Comput..

[30]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.