A nonlinear level set model for image deblurring and denoising

Image deblurring and denoising are fundamental problems in the field of image processing with numerous applications. This paper presents a new nonlinear Partial Differential Equation (PDE) model based on curve evolution via level sets, for recovering images from their blurry and noisy observations. The proposed method integrates an image deconvolution process and a curve evolution based regularizing process to form a reaction-diffusion PDE. The regularization term in the proposed PDE is a combination of a diffusive image smoothing term and a reactive image enhancement term. The diffusive and reactive terms present in the model lead to effective suppression of noise with sharp restoration of image features. We present several numerical results for image restoration, with synthetic and real degradations and compare it to other state-of-the-art image restoration techniques. The experiments confirm the favorable performance of our method, both visually and in terms of Improvement in Signal-to-Noise-Ratio (ISNR) and Pratt’s Figure Of Merit (FOM).

[1]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[2]  S. Angenent.  Parabolic equations for curves on surfaces Part II. Intersections, blow-up and generalized solutions , 1991 .

[3]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Yuying Li,et al.  A computational algorithm for minimizing total variation in image restoration , 1996, IEEE Trans. Image Process..

[5]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[7]  R Malladi,et al.  Image processing via level set curvature flow. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Richard G. Baraniuk,et al.  ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems , 2004, IEEE Transactions on Signal Processing.

[9]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[10]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[11]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[12]  Thomas Brox,et al.  PDE-Based Deconvolution with Forward-Backward Diffusivities and Diffusion Tensors , 2005, Scale-Space.

[13]  Nikolas P. Galatsanos,et al.  Bayesian Restoration Using a New Nonstationary Edge-Preserving Image Prior , 2006, IEEE Transactions on Image Processing.

[14]  Per Christian Hansen,et al.  Regularization methods for large-scale problems , 1993 .

[15]  David Zhang,et al.  Reinitialization-Free Level Set Evolution via Reaction Diffusion , 2011, IEEE Transactions on Image Processing.

[16]  C. Vogel,et al.  Analysis of bounded variation penalty methods for ill-posed problems , 1994 .

[17]  P. Jidesh,et al.  A time-dependent switching anisotropic diffusion model for denoising and deblurring images , 2012 .

[18]  Tien D. Bui,et al.  Image segmentation and selective smoothing by using Mumford-Shah model , 2005, IEEE Transactions on Image Processing.

[19]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[22]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Andrés Almansa,et al.  A TV Based Restoration Model with Local Constraints , 2008, J. Sci. Comput..

[24]  Nikolas P. Galatsanos,et al.  Variational Bayesian Image Restoration Based on a Product of $t$-Distributions Image Prior , 2008, IEEE Transactions on Image Processing.

[25]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[26]  Guillermo Sapiro,et al.  Vector (self) snakes: a geometric framework for color, texture, and multiscale image segmentation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[27]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[28]  A. Carasso.  Linear and Nonlinear Image Deblurring: A Documented Study , 1999 .

[29]  Benjamin B. Kimia,et al.  Image segmentation by reaction-diffusion bubbles , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  James A. Sethian,et al.  A unified approach to noise removal, image enhancement, and shape recovery , 1996, IEEE Trans. Image Process..

[31]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[32]  Fadil Santosa,et al.  Recovery of Blocky Images from Noisy and Blurred Data , 1996, SIAM J. Appl. Math..

[33]  Benjamin B. Kimia,et al.  Shapes, shocks, and deformations I: The components of two-dimensional shape and the reaction-diffusion space , 1995, International Journal of Computer Vision.

[34]  Curtis R. Vogel,et al.  Iterative Methods for Total Variation Denoising , 1996, SIAM J. Sci. Comput..

[35]  J. Sethian.  Evolution, implementation, and application of level set and fast marching methods for advancing fronts , 2001 .

[36]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[37]  Mostafa Kaveh,et al.  Anisotropic blind image restoration , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[38]  B. Vemuri,et al.  Image denoising and segmentation via nonlinear diffusion , 2000 .

[39]  Curtis R. Vogel,et al.  Ieee Transactions on Image Processing Fast, Robust Total Variation{based Reconstruction of Noisy, Blurred Images , 2022 .

[40]  Stanley Osher,et al.  Explicit Algorithms for a New Time Dependent Model Based on Level Set Motion for Nonlinear Deblurring and Noise Removal , 2000, SIAM J. Sci. Comput..

[41]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[42]  G. Aubert,et al.  Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations (Applied Mathematical Sciences) , 2006 .

[43]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[44]  Baba C. Vemuri,et al.  A fast level set based algorithm for topology-independent shape modeling , 1996, Journal of Mathematical Imaging and Vision.