Understanding Blind Deconvolution Algorithms

Blind deconvolution is the recovery of a sharp version of a blurred image when the blur kernel is unknown. Recent algorithms have afforded dramatic progress, yet many aspects of the problem remain challenging and hard to understand. The goal of this paper is to analyze and evaluate recent blind deconvolution algorithms both theoretically and experimentally. We explain the previously reported failure of the naive MAP approach by demonstrating that it mostly favors no-blur explanations. We show that, using reasonable image priors, a naive simulations MAP estimation of both latent image and blur kernel is guaranteed to fail even with infinitely large images sampled from the prior. On the other hand, we show that since the kernel size is often smaller than the image size, a MAP estimation of the kernel alone is well constrained and is guaranteed to succeed to recover the true blur. The plethora of recent deconvolution techniques makes an experimental evaluation on ground-truth data important. As a first step toward this experimental evaluation, we have collected blur data with ground truth and compared recent algorithms under equal settings. Additionally, our data demonstrate that the shift-invariant blur assumption made by most algorithms is often violated.

[1]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[2]  William T. Freeman,et al.  What makes a good model of natural images? , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  J. C. Dainty,et al.  Iterative blind deconvolution method and its applications , 1988 .

[5]  Nikolas P. Galatsanos,et al.  A variational approach for Bayesian blind image deconvolution , 2004, IEEE Transactions on Signal Processing.

[6]  Philip Schniter,et al.  Blind equalization using the constant modulus criterion: a review , 1998, Proc. IEEE.

[7]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[8]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[11]  David J. C. MacKay,et al.  Ensemble Learning for Blind Image Separation and Deconvolution , 2000 .

[12]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[13]  É. Thiébaut,et al.  Strict a priori constraints for maximum-likelihood blind deconvolution , 1995 .

[14]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[15]  Wei Xiong,et al.  Rotational Motion Deblurring of a Rigid Object from a Single Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Eero P. Simoncelli Bayesian Denoising of Visual Images in the Wavelet Domain , 1999 .

[17]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[18]  Richard G. Lane,et al.  Automatic multidimensional deconvolution , 1987 .

[19]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Yehoshua Y. Zeevi,et al.  Quasi Maximum Likelihood Blind Deconvolution of Images Using Optimal Sparse Representations , 2003 .

[21]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[22]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[23]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[24]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Aggelos K. Katsaggelos,et al.  Maximum likelihood blur identification and image restoration using the EM algorithm , 1991, IEEE Trans. Signal Process..

[26]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[27]  M. Hayes The reconstruction of a multidimensional sequence from the phase or magnitude of its Fourier transform , 1982 .

[28]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Aggelos K. Katsaggelos,et al.  A Bayesian approach to blind deconvolution based on Dirichlet distributions , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Jitendra K. Tugnait,et al.  Comments on 'New criteria for blind deconvolution of nonminimum phase systems (channels)' , 1992, IEEE Trans. Inf. Theory.

[31]  G. Ayers,et al.  Interative blind deconvolution method and its applications. , 1988, Optics Letters.