Fast Approximations of Shift-Variant Blur

Image deblurring is essential in high resolution imaging, e.g., astronomy, microscopy or computational photography. Shift-invariant blur is fully characterized by a single point-spread-function (PSF). Blurring is then modeled by a convolution, leading to efficient algorithms for blur simulation and removal that rely on fast Fourier transforms. However, in many different contexts, blur cannot be considered constant throughout the field-of-view, and thus necessitates to model variations of the PSF with the location. These models must achieve a trade-off between the accuracy that can be reached with their flexibility, and their computational efficiency. Several fast approximations of blur have been proposed in the literature. We give a unified presentation of these methods in the light of matrix decompositions of the blurring operator. We establish the connection between different computational tricks that can be found in the literature and the physical sense of corresponding approximations in terms of equivalent PSFs, physically-based approximations being preferable. We derive an improved approximation that preserves the same desirable low complexity as other fast algorithms while reaching a minimal approximation error. Comparison of theoretical properties and empirical performances of each blur approximation suggests that the proposed general model is preferable for approximation and inversion of a known shift-variant blur.

[1]  Lothar Reichel,et al.  Restoration of images with spatially variant blur by the GMRES method , 2000, SPIE Optics + Photonics.

[2]  Jost von Hardenberg,et al.  A fast algorithm for convolution integrals with space and time variant kernels , 2006, J. Comput. Phys..

[3]  Jeffrey A. Fessler,et al.  Accelerated Edge-Preserving Image Restoration Without Boundary Artifacts , 2013, IEEE Transactions on Image Processing.

[4]  Jan P. Allebach,et al.  Fast Space-Varying Convolution Using Matrix Source Coding With Applications to Camera Stray Light Reduction , 2014, IEEE Transactions on Image Processing.

[5]  J. Conan,et al.  Myopic deconvolution from wavefront sensing , 2001 .

[6]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  J. Ng,et al.  Wavelet restoration of medical pulse-echo ultrasound images in an EM framework , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[8]  K. Egiazarian,et al.  Blind image deconvolution , 2007 .

[9]  D. Titterington General structure of regularization procedures in image reconstruction , 1985 .

[10]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[11]  Jean-Michel Morel,et al.  The Non-parametric Sub-pixel Local Point Spread Function Estimation Is a Well Posed Problem , 2011, International Journal of Computer Vision.

[12]  William T. Freeman,et al.  Analyzing spatially-varying blur , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Kathrin Klamroth,et al.  Biconvex sets and optimization with biconvex functions: a survey and extensions , 2007, Math. Methods Oper. Res..

[14]  M. D. Lehnert,et al.  Accounting for the anisoplanatic point spread function in deep wide-field adaptive optics images , 2005, astro-ph/0504467.

[15]  Ferréol Soulez,et al.  Blind deconvolution of 3D data in wide field fluorescence microscopy , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[16]  J. C. Dainty,et al.  Iterative blind deconvolution method and its applications , 1988 .

[17]  Jason D. Fiege,et al.  STRONG GRAVITATIONAL LENS MODELING WITH SPATIALLY VARIANT POINT-SPREAD FUNCTIONS , 2011, 1201.2127.

[18]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[19]  J. Goodman Introduction to Fourier optics , 1969 .

[20]  Ferréol Soulez,et al.  Fast model of space-variant blurring and its application to deconvolution in astronomy , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[22]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Marc Moonen,et al.  Joint DOA and multi-pitch estimation based on subspace techniques , 2012, EURASIP J. Adv. Signal Process..

[24]  Stuart Jefferies,et al.  A computational method for the restoration of images with an unknown, spatially-varying blur. , 2006, Optics express.

[25]  Gilles Aubert,et al.  Blind restoration of confocal microscopy images in presence of a depth-variant blur and Poisson noise , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Bernhard Schölkopf,et al.  Efficient filter flow for space-variant multiframe blind deconvolution , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Laurent M. Mugnier,et al.  Myopic deconvolution from wave-front sensing , 2001 .

[28]  Chrysanthe Preza,et al.  Depth-variant maximum-likelihood restoration for three-dimensional fluorescence microscopy. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Luís B. Almeida,et al.  Blind deblurring of foreground-background images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[31]  A. Dieterlen,et al.  Fluorescence microscopy three-dimensional depth variant point spread function interpolation using Zernike moments , 2011 .

[32]  Dianne P. O'Leary,et al.  Restoring Images Degraded by Spatially Variant Blur , 1998, SIAM J. Sci. Comput..

[33]  Ralf C Flicker,et al.  Anisoplanatic deconvolution of adaptive optics images. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[35]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[36]  James G. Nagy,et al.  Iterative Methods for Image Deblurring: A Matlab Object-Oriented Approach , 2004, Numerical Algorithms.

[37]  Ferréol Soulez,et al.  Inverse problem approach in particle digital holography: out-of-field particle detection made possible. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  D. A. Fish,et al.  Scanning singular-value-decomposition method for restoration of images with space-variant blur , 1996 .

[39]  Javier Portilla,et al.  Efficient shift-variant image restoration using deformable filtering (Part I) , 2012, EURASIP J. Adv. Signal Process..

[40]  Paul Escande,et al.  Numerical Computation of Spatially Varying Blur Operators A Review of Existing Approaches with a New One , 2014 .

[41]  Matteo Frigo,et al.  A fast Fourier transform compiler , 1999, SIGP.

[42]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[43]  V. Mahajan Zernike circle polynomials and optical aberrations of systems with circular pupils. , 1994, Applied optics.

[44]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Pietro Perona,et al.  Overcomplete steerable pyramid filters and rotation invariance , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Yunjin Chen,et al.  Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs , 2014, IEEE Transactions on Image Processing.

[47]  Jan Flusser,et al.  Space-Variant Restoration of Images Degraded by Camera Motion Blur , 2008, IEEE Transactions on Image Processing.

[48]  Stanley J. Reeves,et al.  Fast image restoration without boundary artifacts , 2005, IEEE Transactions on Image Processing.

[49]  Thierry Blu,et al.  Discretization of continuous convolution operators for accurate modeling of wave propagation in digital holography. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[50]  J. Nocedal Updating Quasi-Newton Matrices With Limited Storage , 1980 .

[51]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[52]  Mason A. Porter,et al.  The Extraordinary SVD , 2011, Am. Math. Mon..