On the Equivalence of Soft Wavelet Shrinkage, Total Variation Diffusion, Total Variation Regularization, and SIDEs

Soft wavelet shrinkage, total variation (TV) diffusion, TV regularization, and a dynamical system called SIDEs are four useful techniques for discontinuity preserving denoising of signals and images. In this paper we investigate under which circumstances these methods are equivalent in the one-dimensional case. First, we prove that Haar wavelet shrinkage on a single scale is equivalent to a single step of space-discrete TV diffusion or regularization of two-pixel pairs. In the translationally invariant case we show that applying cycle spinning to Haar wavelet shrinkage on a single scale can be regarded as an absolutely stable explicit discretization of TV diffusion. We prove that space-discrete TV diffusion and TV regularization are identical and that they are also equivalent to the SIDEs system when a specific force function is chosen. Afterwards, we show that wavelet shrinkage on multiple scales can be regarded as a single step diffusion filtering or regularization of the Laplacian pyramid of the signal. We analyze possibilities to avoid Gibbs-like artifacts for multiscale Haar wavelet shrinkage by scaling the thresholds. Finally, we present experiments where hybrid methods are designed that combine the advantages of wavelets and PDE/variational approaches. These methods are based on iterated shift-invariant wavelet shrinkage at multiple scales with scaled thresholds.

[1]  D. Donoho,et al.  Translation-Invariant DeNoising , 1995 .

[2]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[3]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[4]  Fred L. Fontaine,et al.  Wavelet‐based solution to anisotropic diffusion equation for edge detection , 1998 .

[5]  Ronald R. Coifman,et al.  Combining the Calculus of Variations and Wavelets for Image Enhancement , 2000 .

[6]  Jesús Ildefonso Díaz Díaz,et al.  Some qualitative properties for the total variation flow , 2002 .

[7]  Preprint Nr,et al.  On the Equivalence of Soft Wavelet Shrinkage, Total Variation Diusion, Total Variation Regularization, and SIDEs , 2003 .

[8]  L. Vese A Study in the BV Space of a Denoising—Deblurring Variational Problem , 2001 .

[9]  C. Vogel,et al.  Analysis of bounded variation penalty methods for ill-posed problems , 1994 .

[10]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[11]  Joachim Weickert,et al.  Rotationally Invariant Wavelet Shrinkage , 2003, DAGM-Symposium.

[12]  S. Mallat A wavelet tour of signal processing , 1998 .

[13]  Jianhong Shen A Note on Wavelets and Diffusions , 2003 .

[14]  Lyle N. Long,et al.  Unconditionally stable explicit algorithms for nonlinear fluid dynamics problems , 1993 .

[15]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[16]  J CandèsEmmanuel,et al.  New multiscale transforms, minimum total variation synthesis , 2002 .

[17]  Hamid Krim,et al.  Towards Bridging Scale-Space and Multiscale Frame Analyses , 2001 .

[18]  Edward J. Delp,et al.  Discontinuity preserving regularization of inverse visual problems , 1994, IEEE Trans. Syst. Man Cybern..

[19]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[20]  S. Geer,et al.  Locally adaptive regression splines , 1997 .

[21]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jacques Froment,et al.  Reconstruction of Wavelet Coefficients Using Total Variation Minimization , 2002, SIAM J. Sci. Comput..

[23]  Leszek Wojnar,et al.  Image Analysis , 1998 .

[24]  Xuecheng Tai,et al.  A parallel splitting up method and its application to Navier-Stokes equations , 1991 .

[25]  Xiaobing Feng,et al.  Analysis of total variation flow and its finite element approximations , 2003 .

[26]  V. Caselles,et al.  Minimizing total variation flow , 2000, Differential and Integral Equations.

[27]  L. Vese,et al.  A Variational Method in Image Recovery , 1997 .

[28]  R. DeVore,et al.  Nonlinear Approximation and the Space BV(R2) , 1999 .

[29]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[30]  Emmanuel J. Candès,et al.  New multiscale transforms, minimum total variation synthesis: applications to edge-preserving image reconstruction , 2002, Signal Process..

[31]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[32]  François Malgouyres,et al.  Combining total variation and wavelet packet approaches for image deblurring , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[33]  Tony F. Chan,et al.  Total variation improved wavelet thresholding in image compression , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[34]  M. Novaga,et al.  The Total Variation Flow in RN , 2002 .

[35]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[36]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[37]  F. Malgouyres,et al.  Mathematical analysis of a model which combines total variation and wavelet for image restoration 1 , 2002 .

[38]  Gerhard Winkler,et al.  Image analysis, random fields and dynamic Monte Carlo methods: a mathematical introduction , 1995, Applications of mathematics.

[39]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[40]  Joachim Weickert,et al.  Relations between Soft Wavelet Shrinkage and Total Variation Denoising , 2002, DAGM-Symposium.

[41]  Thomas Brox,et al.  Equivalence Results for TV Diffusion and TV Regularisation , 2003, Scale-Space.

[42]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[43]  Eric L. Miller,et al.  Wavelet domain image restoration with adaptive edge-preserving regularization , 2000, IEEE Trans. Image Process..

[44]  Leonid P. Yaroslavsky,et al.  Nonlinear Filters in Image Processing , 2004 .

[45]  Gilbert Strang,et al.  On Wavelet Fundamental Solutions to the Heat Equation—Heatlets , 2000 .

[46]  Fred L. Fontaine,et al.  Wavelet-based solution to anisotropic diffusion equation for edge detection , 1998, Int. J. Imaging Syst. Technol..

[47]  J. Weickert,et al.  Image Processing Using a Wavelet Algorithm for Nonlinear Diffusion , 1994 .

[48]  Antonin Chambolle,et al.  Interpreting translation-invariant wavelet shrinkage as a new image smoothing scale space , 2001, IEEE Trans. Image Process..

[49]  Otmar Scherzer,et al.  Tube Methods for BV Regularization , 2003, Journal of Mathematical Imaging and Vision.

[50]  Stan Z. Li,et al.  Close-Form Solution and Parameter Selection for Convex Minimization-Based Edge-Preserving Smoothing , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  G. Smith,et al.  Numerical Solution of Partial Differential Equations: Finite Difference Methods , 1978 .

[52]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[53]  Philippe Saint-Marc,et al.  Adaptive Smoothing: A General Tool for Early Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Jong-Sen Lee,et al.  Digital image smoothing and the sigma filter , 1983, Comput. Vis. Graph. Image Process..

[55]  R. DeVore,et al.  Nonlinear approximation and the space BV[inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="01i" /] , 1999 .

[56]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[57]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[58]  Martin Vetterli,et al.  Oversampled filter banks , 1998, IEEE Trans. Signal Process..

[59]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[61]  Alan S. Willsky,et al.  Image segmentation and edge enhancement with stabilized inverse diffusion equations , 2000, IEEE Trans. Image Process..

[62]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[63]  Joachim Weickert,et al.  On Iterations and Scales of Nonlinear Filters , 2003 .

[64]  Ronald R. Coifman,et al.  New Methods of Controlled Total Variation Reduction for Digital Functions , 2001, SIAM J. Numer. Anal..

[65]  Niklas Nordström,et al.  Biased anisotropic diffusion: a unified regularization and diffusion approach to edge detection , 1990, Image Vis. Comput..

[66]  Jörg Weule,et al.  Non-Linear Gaussian Filters Performing Edge Preserving Diffusion , 1995, DAGM-Symposium.

[67]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[68]  Joachim Weickert,et al.  Relations Between Regularization and Diffusion Filtering , 2000, Journal of Mathematical Imaging and Vision.

[69]  Christoph Schnörr,et al.  Unique reconstruction of piecewise-smooth images by minimizing strictly convex nonquadratic functionals , 1994, Journal of Mathematical Imaging and Vision.

[70]  Achilleas S. Frangakis,et al.  Wavelet transform filtering and nonlinear anisotropic diffusion assessed for signal reconstruction performance on multidimensional biomedical data , 2001, IEEE Transactions on Biomedical Engineering.

[71]  I. Daubechies,et al.  Harmonic analysis of the space BV. , 2003 .

[72]  Reinhard Klette,et al.  Handbook of image processing operators , 1996 .