Blind restoration of space-variant Gaussian-like blurred images using regional PSFs

In this paper, we propose an alternative de-blurring method to remove Gaussian blurs (that approximate distortions such as out-of-focus and long atmospheric path). Our research focuses on images that contain space-variant blurs, as well as focused objects within the same image. We propose to use estimated depth map-based segmentation for space-variant blind image de-blurring. Unlike previous studies that assume PSF or use one calculated PSF for the entire image, our method composes re-blurred images using different calculated PSF’s and combining the restored images to one restored image. The proposed method contains several parts: blur map estimation based on edge-width analysis, division of the image into several layers according to the blur severity, and extraction of the point-spread function (PSF) that characterizes the blur at each layer. Next, each layer is de-blurred using its specific PSF and the total variation method; the de-blurred layers are combined forming the final restored image. A main challenge is to prevent distortions of the sharper objects in the image while simultaneously sharpening the blurrier objects.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yitzhak Yitzhaky,et al.  Blind restoration of atmospherically degraded images by automatic best step-edge detection , 2007, Pattern Recognit. Lett..

[3]  A. Chambolle,et al.  An introduction to Total Variation for Image Analysis , 2009 .

[4]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[5]  Wen-Liang Hwang,et al.  Multiple depth layers and all-in-focus image generations by blurring and deblurring operations , 2017, Pattern Recognit..

[6]  Yu-Wing Tai,et al.  Detail Recovery for Single-image Defocus Blur (IPSJ Transactions on Computer Vision and Applications Vol.1) , 2009 .

[7]  C. A. Dvorak,et al.  Detection and discrimination of blur in edges and lines , 1981 .

[8]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Filip Sroubek,et al.  Space-variant deblurring using one blurred and one underexposed image , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[10]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[11]  Gilles Aubert,et al.  Space Variant Blind Image Restoration , 2014, SIAM J. Imaging Sci..

[12]  J. Flusser,et al.  Towards Super-Resolution in the Presence of Spatially Varying Blur , 2017 .

[13]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Wen-Liang Hwang,et al.  Spatially-varying out-of-focus image deblurring with L1-2 optimization and a guided blur map , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Michael S. Brown,et al.  Single image defocus map estimation using local contrast prior , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[16]  Kirsi Majava,et al.  Optimization-based techniques for image restoration , 2001 .

[17]  Stephen Lin,et al.  Detail Recovery for Single-image Defocus Blur , 2009, IPSJ Trans. Comput. Vis. Appl..

[18]  Aggelos K. Katsaggelos,et al.  Image prior combination in space-variant blur deconvolution for the dual exposure problem , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[19]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..