Parametric Blur Estimation for Blind Restoration of Natural Images: Linear Motion and Out-of-Focus

This paper presents a new method to estimate the parameters of two types of blurs, linear uniform motion (approximated by a line characterized by angle and length) and out-of-focus (modeled as a uniform disk characterized by its radius), for blind restoration of natural images. The method is based on the spectrum of the blurred images and is supported on a weak assumption, which is valid for the most natural images: the power-spectrum is approximately isotropic and has a power-law decay with the spatial frequency. We introduce two modifications to the radon transform, which allow the identification of the blur spectrum pattern of the two types of blurs above mentioned. The blur parameters are identified by fitting an appropriate function that accounts separately for the natural image spectrum and the blur frequency response. The accuracy of the proposed method is validated by simulations, and the effectiveness of the proposed method is assessed by testing the algorithm on real natural blurred images and comparing it with state-of-the-art blind deconvolution methods.

[1]  M. Brédif,et al.  DETECTING AND CORRECTING MOTION BLUR FROM IMAGES SHOT WITH CHANNEL-DEPENDENT EXPOSURE TIME , 2012 .

[2]  José M. Bioucas-Dias,et al.  Blind Estimation of Motion Blur Parameters for Image Deconvolution , 2007, IbPRIA.

[3]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Gang Liu,et al.  Aerial image blurring caused by image motion and its restoration using wavelet transform , 2005, SPIE/COS Photonics Asia.

[5]  David J. C. MacKay,et al.  Ensemble Learning for Blind Image Separation and Deconvolution , 2000 .

[6]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[7]  Raanan Fattal,et al.  Blur-Kernel Estimation from Spectral Irregularities , 2012, ECCV.

[8]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[9]  S. D. Babacan,et al.  Blind image deconvolution: theory and applications , 2007 .

[10]  Nahum Kiryati,et al.  Variational Pairing of Image Segmentation and Blind Restoration , 2004, ECCV.

[11]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[12]  Aapo Hyvärinen,et al.  Natural Image Statistics - A Probabilistic Approach to Early Computational Vision , 2009, Computational Imaging and Vision.

[13]  E. Uchino,et al.  Robust Identification of Motion Blur Parameters by Using Angles of Gradient Vectors , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[14]  Alan V. Oppenheim,et al.  Discrete-time signal processing (2nd ed.) , 1999 .

[15]  M. Moghaddam,et al.  A Mathematical Model to Estimate Out of Focus Blur , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[16]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[17]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[18]  M. Jamzad,et al.  Motion blur identification in noisy images using fuzzy sets , 2005, Proceedings of the Fifth IEEE International Symposium on Signal Processing and Information Technology, 2005..

[19]  B. P. Bogert,et al.  The quefrency analysis of time series for echoes : cepstrum, pseudo-autocovariance, cross-cepstrum and saphe cracking , 1963 .

[20]  Luís B. Almeida,et al.  Blind and Semi-Blind Deblurring of Natural Images , 2010, IEEE Transactions on Image Processing.

[21]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[22]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[23]  Hui Ji,et al.  Motion blur identification from image gradients , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Jean-Luc Starck,et al.  Deconvolution and Blind Deconvolution in Astronomy , 2007 .

[27]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[29]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[30]  Kun Gao,et al.  Motion-blur parameter estimation of remote sensing image based on quantum neural network , 2011, International Conference on Optical Instruments and Technology.

[31]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[32]  Deepa Kundur,et al.  Blind image deconvolution revisited , 1996 .

[33]  Alfred S. Carasso,et al.  Direct Blind Deconvolution , 2001, SIAM J. Appl. Math..

[34]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[35]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[36]  Masatoshi Okutomi,et al.  Motion Blur Parameter Identification from a Linearly Blurred Image , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[37]  Chih-Li Huo,et al.  Out-of-focus blur estimation for blind image deconvolution: Using particle swarm optimization , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[38]  Long Quan,et al.  Image deblurring with blurred/noisy image pairs , 2007, SIGGRAPH 2007.

[39]  Antonio. Garcia-Valdecasas,et al.  Two-Dimensional Imaging , 1996 .

[40]  F. Natterer.  The Mathematics of Computerized Tomography , 1986 .

[41]  Xinqiao Liu,et al.  Simultaneous image formation and motion blur restoration via multiple capture , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[42]  A. Murat Tekalp,et al.  Blur identification using the bispectrum , 1991, IEEE Trans. Signal Process..

[43]  Subhasis Chaudhuri,et al.  Blind Image Deconvolution , 2014, Springer International Publishing.

[44]  Wotao Yin,et al.  Compressed Sensing via Iterative Support Detection , 2009, ArXiv.

[45]  Andreas E. Savakis,et al.  On the accuracy of PSF representation in image restoration , 1993, IEEE Trans. Image Process..

[46]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[47]  Harry Shum,et al.  Image deblurring with blurred/noisy image pairs , 2007, ACM Trans. Graph..

[48]  RaskarRamesh,et al.  Coded exposure photography , 2006 .

[49]  E. Stein,et al.  Introduction to Fourier Analysis on Euclidean Spaces. , 1971 .

[50]  Brendt Wohlberg,et al.  Blind Image Deconvolution Motion Blur Estimation , 2006 .

[51]  Shmuel Peleg,et al.  Two motion-blurred images are better than one , 2005, Pattern Recognit. Lett..