A Simple Local Minimal Intensity Prior and an Improved Algorithm for Blind Image Deblurring

Blind image deblurring is a long standing challenging problem in image processing and low-level vision. Recently, sophisticated priors such as dark channel prior, extreme channel prior, and local maximum gradient prior, have shown promising effectiveness. However, these methods are computationally expensive. Meanwhile, since these priors involved subproblems cannot be solved explicitly, approximate solution is commonly used, which limits the best exploitation of their capability. To address these problems, this work firstly proposes a simplified sparsity prior of local minimal pixels, namely patch-wise minimal pixels (PMP). The PMP of clear images is much more sparse than that of blurred ones, and hence is very effective in discriminating between clear and blurred images. Then, a novel algorithm is designed to efficiently exploit the sparsity of PMP in deblurring. The new algorithm flexibly imposes sparsity inducing on the PMP under the MAP framework rather than directly uses the half quadratic splitting algorithm. By this, it avoids non-rigorous approximation solution in existing algorithms, while being much more computationally efficient. Extensive experiments demonstrate that the proposed algorithm can achieve better practical stability compared with state-of-the-arts. In terms of deblurring quality, robustness and computational efficiency, the new algorithm is superior to state-of-the-arts. Code for reproducing the results of the new method is available at this https URL.

[1]  Tae Hyun Kim,et al.  Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[3]  Ming-Hsuan Yang,et al.  Joint Depth Estimation and Camera Shake Removal from Single Blurry Image , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Jian Zhang,et al.  Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ming-Hsuan Yang,et al.  Learning a Discriminative Prior for Blind Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Jiri Matas,et al.  DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Xiaochun Cao,et al.  Image Deblurring via Extreme Channels Prior , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Michal Irani,et al.  Blind Deblurring Using Internal Patch Recurrence , 2014, ECCV.

[10]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[12]  Sylvain Paris,et al.  Blur kernel estimation using the radon transform , 2011, CVPR 2011.

[13]  Fei Wen,et al.  Robust PCA Using Generalized Nonconvex Regularization , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Jiaya Jia,et al.  Mathematical models and practical solvers for uniform motion deblurring , 2014, Motion Deblurring.

[15]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[16]  Rynson W. H. Lau,et al.  Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Haichao Zhang,et al.  Revisiting Bayesian blind deconvolution , 2013, J. Mach. Learn. Res..

[18]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[19]  Bernhard Schölkopf,et al.  Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database , 2012, ECCV.

[20]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[21]  Andrew Zisserman,et al.  Deblurring shaken and partially saturated images , 2011, ICCV Workshops.

[22]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[23]  Sunghyun Cho,et al.  Edge-based blur kernel estimation using patch priors , 2013, IEEE International Conference on Computational Photography (ICCP).

[24]  Hua Huang,et al.  Bundled Kernels for Nonuniform Blind Video Deblurring , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Yong Li,et al.  Reconstruction of Single Image from Multiple Blurry Measured Images , 2018, IEEE Transactions on Image Processing.

[26]  Daniele Perrone,et al.  Total Variation Blind Deconvolution: The Devil Is in the Details , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Seungyong Lee,et al.  Text Image Deblurring Using Text-Specific Properties , 2012, ECCV.

[28]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Deqing Sun,et al.  Blind Image Deblurring Using Dark Channel Prior , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Wenxian Yu,et al.  Efficient and Robust Recovery of Sparse Signal and Image Using Generalized Nonconvex Regularization , 2017, IEEE Transactions on Computational Imaging.

[31]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[32]  James H. Money,et al.  Total variation minimizing blind deconvolution with shock filter reference , 2008, Image Vis. Comput..

[33]  Wen Gao,et al.  Single-Image Blind Deblurring Using Multi-Scale Latent Structure Prior , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Enhua Wu,et al.  Depth-Aware Motion Deblurring Using Loopy Belief Propagation , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Ankit Gupta,et al.  Single Image Deblurring Using Motion Density Functions , 2010, ECCV.

[36]  Yi Wang,et al.  Scale-Recurrent Network for Deep Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Li Xu,et al.  Depth-aware motion deblurring , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[38]  Bernhard Schölkopf,et al.  Fast removal of non-uniform camera shake , 2011, 2011 International Conference on Computer Vision.

[39]  Jean Ponce,et al.  Learning a convolutional neural network for non-uniform motion blur removal , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[41]  Guangcan Liu,et al.  Blind Image Deblurring Using Spectral Properties of Convolution Operators , 2014, IEEE Transactions on Image Processing.

[42]  Guixu Zhang,et al.  Blind Image Deblurring With Local Maximum Gradient Prior , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Li Xu,et al.  Forward Motion Deblurring , 2013, 2013 IEEE International Conference on Computer Vision.

[44]  Seungyong Lee,et al.  Handling outliers in non-blind image deconvolution , 2011, 2011 International Conference on Computer Vision.

[45]  Deqing Sun,et al.  Deblurring Images via Dark Channel Prior , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Ming-Hsuan Yang,et al.  Deblurring Low-Light Images with Light Streaks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.