Blind image deblurring based on the sparsity of patch minimum information

Abstract Blind image deblurring is a very challenging inverse problem due to the severe ill-posedness caused by the unknown kernel and the latent clear image. To tackle this problem, appropriate smoothing regularizations and image priors are usually employed and incorporated into the associated variational models to alleviate the inherent ill-posedness. In this paper, we first propose a strongly imposed zero patch minimum constraint for the latent image, which helps alleviate the ill-posedness of the inverse problem for blind image deblurring. Then, we retrieve important fine details by assigning the patch minimum information obtained from the blurred image back to the latent image to further enhance its structure. Finally, we introduce an adaptive regularizer which was shown to have significantly better edge-preserving property than the total variation regularizer for the image restoration of degraded images. Operator splitting techniques are used to accomplish an efficient numerical implementation of the proposed variational model. A number of numerical experiments and comparisons with some state-of-the-art methods are conducted to demonstrate the effective performance of the newly proposed method.

[1]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[2]  Daniele Perrone,et al.  Total Variation Blind Deconvolution: The Devil Is in the Details , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jiangming Kan,et al.  Blind color-image deblurring based on color image gradients , 2019, Signal Process..

[4]  Zhongbo Zhang,et al.  An adaptive parameter estimation for guided filter based image deconvolution , 2016, Signal Process..

[5]  Ming-Hsuan Yang,et al.  Deblurring Text Images via L0-Regularized Intensity and Gradient Prior , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ming-Hsuan Yang,et al.  $L_0$ -Regularized Intensity and Gradient Prior for Deblurring Text Images and Beyond , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[8]  Amir Masoud Rahmani,et al.  Blind image deblurring based on multi-resolution ringing removal , 2019, Signal Process..

[9]  Mostafa Kaveh,et al.  A regularization approach to joint blur identification and image restoration , 1996, IEEE Trans. Image Process..

[10]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[11]  Yitzhak Yitzhaky,et al.  Identification of Blur Parameters from Motion Blurred Images , 1997, CVGIP Graph. Model. Image Process..

[12]  Houzhang Fang,et al.  Blind image deconvolution with spatially adaptive total variation regularization. , 2012, Optics letters.

[13]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[14]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[15]  Chak-Kuen Wong,et al.  Total variation image restoration: numerical methods and extensions , 1997, Proceedings of International Conference on Image Processing.

[16]  Deqing Sun,et al.  Deblurring Images via Dark Channel Prior , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jian-Feng Cai,et al.  Framelet-Based Blind Motion Deblurring From a Single Image , 2012, IEEE Transactions on Image Processing.

[18]  Michal Irani,et al.  Blind Deblurring Using Internal Patch Recurrence , 2014, ECCV.

[19]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[20]  John W. Woods,et al.  Compound Gauss-Markov random fields for image estimation , 1991, IEEE Trans. Signal Process..

[21]  Rick Chartrand,et al.  Nonconvex Regularization for Shape Preservation , 2007, 2007 IEEE International Conference on Image Processing.

[22]  Sunghyun Cho,et al.  Edge-based blur kernel estimation using patch priors , 2013, IEEE International Conference on Computational Photography (ICCP).

[23]  Zhihui Wei,et al.  Regularized motion blur-kernel estimation with adaptive sparse image prior learning , 2016, Pattern Recognit..

[24]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[25]  D. Donoho Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition , 1995 .

[26]  Narendra Ahuja,et al.  A Comparative Study for Single Image Blind Deblurring , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Shuaiqi Liu,et al.  Total variation image restoration using hyper-Laplacian prior with overlapping group sparsity , 2016, Signal Process..

[28]  Po-Wen Hsieh,et al.  A regularization model with adaptive diffusivity for variational image denoising , 2017, Signal Process..

[29]  Sylvain Paris,et al.  Handling Noise in Single Image Deblurring Using Directional Filters , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[31]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[32]  Shang-Hong Lai,et al.  A novel gradient attenuation Richardson-Lucy algorithm for image motion deblurring , 2014, Signal Process..

[33]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[34]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[35]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[36]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[37]  Jack Xin,et al.  A Weighted Difference of Anisotropic and Isotropic Total Variation Model for Image Processing , 2015, SIAM J. Imaging Sci..

[38]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, SIGGRAPH 2008.

[39]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[40]  Tianxu Zhang,et al.  Blind restoration of real turbulence-degraded image with complicated backgrounds using anisotropic regularization , 2012 .

[41]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[43]  Yanning Zhang,et al.  Multi-image Blind Deblurring Using a Coupled Adaptive Sparse Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Frédo Durand,et al.  Understanding Blind Deconvolution Algorithms , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[46]  Jian Sun,et al.  Progressive inter-scale and intra-scale non-blind image deconvolution , 2008, SIGGRAPH 2008.

[47]  Lionel Moisan,et al.  Total Variation as a Local Filter , 2011, SIAM J. Imaging Sci..

[48]  D. Donoho Unconditional Bases Are Optimal Bases for Data Compression and for Statistical Estimation , 1993 .

[49]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[50]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[51]  S. Avidan,et al.  Diving into Haze-Lines: Color Restoration of Underwater Images , 2017 .

[52]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[54]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[55]  Chuanjiang He,et al.  Fractional order total variation regularization for image super-resolution , 2013, Signal Process..

[56]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[57]  Haichao Zhang,et al.  Revisiting Bayesian blind deconvolution , 2013, J. Mach. Learn. Res..

[58]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[59]  Mauricio Delbracio,et al.  Blind Image Deblurring using the l0 Gradient Prior , 2019, Image Process. Line.

[60]  Curtis R. Vogel,et al.  Iterative Methods for Total Variation Denoising , 1996, SIAM J. Sci. Comput..