Understanding and evaluating blind deconvolution algorithms

Blind deconvolution is the recovery of a sharp version of a blurred image when the blur kernel is unknown. Recent algorithms have afforded dramatic progress, yet many aspects of the problem remain challenging and hard to understand. The goal of this paper is to analyze and evaluate recent blind deconvolution algorithms both theoretically and experimentally. We explain the previously reported failure of the naive MAP approach by demonstrating that it mostly favors no-blur explanations. On the other hand we show that since the kernel size is often smaller than the image size a MAP estimation of the kernel alone can be well constrained and accurately recover the true blur. The plethora of recent deconvolution techniques makes an experimental evaluation on ground-truth data important. We have collected blur data with ground truth and compared recent algorithms under equal settings. Additionally, our data demonstrates that the shift-invariant blur assumption made by most algorithms is often violated.

[1]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[2]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[3]  M. Hayes The reconstruction of a multidimensional sequence from the phase or magnitude of its Fourier transform , 1982 .

[4]  Richard G. Lane,et al.  Automatic multidimensional deconvolution , 1987 .

[5]  G. Ayers,et al.  Interative blind deconvolution method and its applications. , 1988, Optics Letters.

[6]  Aggelos K. Katsaggelos,et al.  Maximum likelihood blur identification and image restoration using the EM algorithm , 1991, IEEE Trans. Signal Process..

[7]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[8]  É. Thiébaut,et al.  Strict a priori constraints for maximum-likelihood blind deconvolution , 1995 .

[9]  Aggelos K. Katsaggelos,et al.  A Bayesian approach to blind deconvolution based on Dirichlet distributions , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Eero P. Simoncelli Bayesian Denoising of Visual Images in the Wavelet Domain , 1999 .

[12]  B. Vidakovic,et al.  Bayesian Inference in Wavelet-Based Models , 1999 .

[13]  David J. C. MacKay,et al.  Ensemble Learning for Blind Image Separation and Deconvolution , 2000 .

[14]  Jia Jie Bayesian denoising of visual images in the wavelet domain , 2003 .

[15]  Nikolas P. Galatsanos,et al.  A variational approach for Bayesian blind image deconvolution , 2004, IEEE Transactions on Signal Processing.

[16]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Yehoshua Y. Zeevi,et al.  Quasi Maximum Likelihood Blind Deconvolution of Images Using Optimal Sparse Representations , 2003 .

[18]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[19]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[20]  Wei Xiong,et al.  Rotational Motion Deblurring of a Rigid Object from a Single Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  B. Schölkopf,et al.  Blind Motion Deblurring Using Image Statistics , 2007 .

[23]  William T. Freeman,et al.  What makes a good model of natural images? , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[25]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[27]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.