Relations Between Regularization and Diffusion Filtering

Regularization may be regarded as diffusion filtering with an implicit time discretization where one single step is used. Thus, iterated regularization with small regularization parameters approximates a diffusion process. The goal of this paper is to analyse relations between noniterated and iterated regularization and diffusion filtering in image processing. In the linear regularization framework, we show that with iterated Tikhonov regularization noise can be better handled than with noniterated. In the nonlinear framework, two filtering strategies are considered: the total variation regularization technique and the diffusion filter technique of Perona and Malik. It is shown that the Perona-Malik equation decreases the total variation during its evolution. While noniterated and iterated total variation regularization is well-posed, one cannot expect to find a minimizing sequence which converges to a minimizer of the corresponding energy functional for the Perona–Malik filter. To overcome this shortcoming, a novel regularization technique of the Perona–Malik process is presented that allows to construct a weakly lower semi-continuous energy functional. In analogy to recently derived results for a well-posed class of regularized Perona–Malik filters, we introduce Lyapunov functionals and convergence results for regularization methods. Experiments on real-world images illustrate that iterated linear regularization performs better than noniterated, while no significant differences between noniterated and iterated total variation regularization have been observed.

[1]  Joachim Weickert,et al.  A Review of Nonlinear Diffusion Filtering , 1997, Scale-Space.

[2]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Michel Barlaud,et al.  Two deterministic half-quadratic regularization algorithms for computed imaging , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[5]  Luc Florack,et al.  Image Structure , 1997, Computational Imaging and Vision.

[6]  Bernard Dacorogna,et al.  Weak Continuity and Weak Lower Semicontinuity of Non-Linear Functionals , 1982 .

[7]  Charles W. Groetsch,et al.  Spectral methods for linear inverse problems with unbounded operators , 1992 .

[8]  Mark Nitzberg,et al.  Nonlinear Image Filtering with Edge and Corner Enhancement , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[10]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[11]  J. Weidmann Lineare Operatoren in Hilberträumen , 2000 .

[12]  Curtis R. Vogel,et al.  Ieee Transactions on Image Processing Fast, Robust Total Variation{based Reconstruction of Noisy, Blurred Images , 2022 .

[13]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[14]  Peter Johansen,et al.  Gaussian Scale-Space Theory , 1997, Computational Imaging and Vision.

[15]  Joachim Weickert,et al.  A semidiscrete nonlinear scale-space theory and its relation to the Perona - Malik paradox , 1996, TFCV.

[16]  P. Green Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[17]  Christoph Schnörr,et al.  Unique reconstruction of piecewise-smooth images by minimizing strictly convex nonquadratic functionals , 1994, Journal of Mathematical Imaging and Vision.

[18]  Yuying Li,et al.  A computational algorithm for minimizing total variation in image restoration , 1996, IEEE Trans. Image Process..

[19]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[20]  M. Nashed,et al.  Least squares and bounded variation regularization with nondifferentiable functionals , 1998 .

[21]  Otmar Scherzer Stable Evaluation of Diierential Operators and Linear and Nonlinear Multi{scale Ltering , 1997 .

[22]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[23]  C. Vogel,et al.  Analysis of bounded variation penalty methods for ill-posed problems , 1994 .

[24]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[25]  C. W. Groetsch,et al.  The theory of Tikhonov regularization for Fredholm equations of the first kind , 1984 .

[26]  Joachim Weickert,et al.  Scale-Space Properties of Regularization Methods , 1999, Scale-Space.

[27]  D. Dobson,et al.  Analysis of regularized total variation penalty methods for denoising , 1996 .

[28]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[30]  V. A. Morozov,et al.  Methods for Solving Incorrectly Posed Problems , 1984 .

[31]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[32]  G. Koepfler,et al.  A morphological scheme for mean curvature motion and applications to anisotropic diffusion and motion of level sets , 1995 .

[33]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[34]  L. Evans Measure theory and fine properties of functions , 1992 .

[35]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[36]  K. Kunisch,et al.  An active set strategy based on the augmented Lagrangian formulation for image restoration , 1999 .

[37]  D. Gilbarg,et al.  Elliptic Partial Differential Equa-tions of Second Order , 1977 .

[38]  O. Scherzer Stable Evaluation of Differential Operators and Linear and Nonlinear Multi-scale Filtering , 1997 .

[39]  Gilbert Helmberg,et al.  Introduction to Spectral Theory in Hilbert Space , 1970 .

[40]  G. I. Barenblatt,et al.  A degenerate pseudoparabolic regularization of a nonlinear forward-backward heat equation arising in the theory of heat and mass exchange in stably stratified turbulent shear flow , 1993 .

[41]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[42]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[43]  Rachid Deriche,et al.  Regularization, Scale-Space, and Edge Detection Filters , 1996, Journal of Mathematical Imaging and Vision.

[44]  D. Dobson,et al.  Convergence of an Iterative Method for Total Variation Denoising , 1997 .

[45]  Rachid Deriche,et al.  Regularization, Scale-Space, and Edge Detection Filters , 1996, ECCV.

[46]  E. Giusti Minimal surfaces and functions of bounded variation , 1977 .

[47]  Niklas Nordström Biased Anisotropic Diffusion - A Unified Regularization and Diffusion Approach to Edge Detection , 1990, ECCV.

[48]  Otmar Scherzer,et al.  The Optimal Order of Convergence for Stable Evaluation of Differential Operators , 1993 .

[49]  M. Hanke,et al.  Nonstationary Iterated Tikhonov Regularization , 1998 .