Blur kernel optimization with contrast levels and effectual patch selection using SURF features

Single image blind deblurring is a challenging and well known ill-posed problem. Recently, with the emergence of many effective algorithms to estimate blur kernels, the research for blur kernel refinement and for developing fast and reliable methods to utilize effectual image regions is becoming increasingly important. Generally, multiscale framework is used for blur kernel refinement to avoid trapping in local minima, however, we recommend to use images with increasing contrast levels which gradually improves blur kernel estimation. To make the kernel estimation more efficient, we used effectual patches instead of whole image, which not only make the restoration efficient but also improves the results by discarding the ineffectual regions. It is especially well suited for the large satellite images corrupted with atmospheric turbulence, motion blur or objects with uniform background. After extensive analysis and comparison with other methods, speed-up robust features (SURF) based patch selection method is proposed. In addition, masking based on gradient directions is also found useful in suppressing misleading regions. Finally, a new scheme is proposed and analyzed which combine the effectual regions as well as contrast levels. The results are found to be improved significantly using SURF based patches, gradient direction masking and contrast level images. The comparisons show the effectiveness of proposed approach.

[1]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[2]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[3]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.

[4]  Jian-Feng Cai,et al.  Blind motion deblurring from a single image using sparse approximation , 2009, CVPR.

[5]  David Nistér,et al.  Linear Time Maximally Stable Extremal Regions , 2008, ECCV.

[6]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[7]  D. A. Fish,et al.  Blind deconvolution by means of the Richardson-Lucy algorithm. , 1995 .

[8]  Zhixun Su,et al.  Kernel estimation from salient structure for robust motion deblurring , 2012, Signal Process. Image Commun..

[9]  Andy M. Yip,et al.  Total Variation Image Restoration: Overview and Recent Developments , 2006, Handbook of Mathematical Models in Computer Vision.

[10]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[12]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[14]  Norman S. Kopeika,et al.  A System Engineering Approach to Imaging , 1998 .

[15]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Alfred O. Hero,et al.  Correcting camera shake by incremental sparse approximation , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Mostafa Kaveh,et al.  Blind image restoration by anisotropic regularization , 1999, IEEE Trans. Image Process..

[18]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[19]  Aggelos K. Katsaggelos,et al.  Bayesian Blind Deconvolution with General Sparse Image Priors , 2012, ECCV.

[20]  Charless C. Fowlkes,et al.  Patch Mosaic for Fast Motion Deblurring , 2012, ACCV.

[21]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[22]  Long Quan,et al.  Image deblurring with blurred/noisy image pairs , 2007, SIGGRAPH 2007.

[23]  Shang-Hong Lai,et al.  Image deblurring by exploiting inherent bi-level regions , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[24]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[25]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[26]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[28]  Ming-Hsuan Yang,et al.  Good Regions to Deblur , 2012, ECCV.

[29]  Miles E. Lopes.  Estimating Unknown Sparsity in Compressed Sensing , 2013 .

[30]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[31]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[32]  Jian Sun,et al.  Progressive inter-scale and intra-scale non-blind image deconvolution , 2008, SIGGRAPH 2008.