Simultaneous blur map estimation and deblurring of a single space-variantly defocused image

In this work we address the problem of blind deblurring using a single space-variantly defocused image containing text. We estimate both the all-in-focus image and the blur map corresponding to the space-variant point spread function of the finite aperture camera. Since this problem is highly ill-posed we exploit a recently proposed technique [1] to obtain an initial estimate of the space-variant blur map which is used in an MAP-MRF alternating minimization framework. We obtain analytically the gradients with respect to the unknowns and show that the proposed objective function can be successfully optimized with the steepest descent technique. Initially, we show results using the Gauss-Markov random field (GMRF) prior and then contrast its performance with the discontinuity adaptive Markov random field (DAMRF) prior. We show that details such as edges and fine details are preserved by the DAMRF regularizer. We compare the results of our algorithm with state-of-the-art techniques and provide both qualitative and quantitative evaluation.

[1]  Chucai Yi,et al.  Text String Detection From Natural Scenes by Structure-Based Partition and Grouping , 2011, IEEE Transactions on Image Processing.

[2]  Xiaochun Cao,et al.  Scene Text Deblurring Using Text-Specific Multiscale Dictionaries , 2015, IEEE Transactions on Image Processing.

[3]  Shijian Lu,et al.  Blurred image region detection and classification , 2011, ACM Multimedia.

[4]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[5]  Xin Yi,et al.  LBP-Based Segmentation of Defocus Blur , 2016, IEEE Transactions on Image Processing.

[6]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[7]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.

[9]  Yasuyuki Matsushita,et al.  Removing Non-Uniform Motion Blur from Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Deqing Sun,et al.  Blind Image Deblurring Using Dark Channel Prior , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jianping Shi,et al.  Just noticeable defocus blur detection and estimation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[13]  Yanning Zhang,et al.  Blind image deblurring based on sparse prior of dictionary pair , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  A. N. Rajagopalan,et al.  Discontinuity-Adaptive Shape from Focus Using a Non-convex Prior , 2009, DAGM-Symposium.

[15]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[16]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[17]  Yonatan Wexler,et al.  Detecting text in natural scenes with stroke width transform , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Kang Wang,et al.  A two-stage approach to blind spatially-varying motion deblurring , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ming-Hsuan Yang,et al.  $L_0$ -Regularized Intensity and Gradient Prior for Deblurring Text Images and Beyond , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Seungyong Lee,et al.  Text Image Deblurring Using Text-Specific Properties , 2012, ECCV.