Demystifying the Asymptotic Behavior of Global Denoising

In this work, we revisit the global denoising framework recently introduced by Talebi and Milanfar. We analyze the asymptotic behavior of its mean-squared error restoration performance in the oracle case when the image size tends to infinity. We introduce precise conditions on both the image and the global filter to ensure and quantify this convergence. We also make a clear distinction between two different levels of oracle that are used in that framework. By reformulating global denoising with the classical formalism of diagonal estimation, we conclude that the second-level oracle can be avoided by using Donoho and Johnstone’s theorem, whereas the first-level oracle is mostly required in the sequel. We also discuss open issues concerning the most challenging aspect, namely the extension of these results to the case where neither oracle is required.

[1]  Frédo Durand,et al.  Patch Complexity, Finite Pixel Correlations and Optimal Denoising , 2012, ECCV.

[2]  Jean-François Aujol,et al.  Irregular to Regular Sampling, Denoising, and Deconvolution , 2009, Multiscale Model. Simul..

[3]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[4]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Jean-Michel Morel,et al.  SURE Guided Gaussian Mixture Image Denoising , 2013, SIAM J. Imaging Sci..

[6]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[7]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[8]  M. Brand,et al.  Fast low-rank modifications of the thin singular value decomposition , 2006 .

[9]  L. P. I︠A︡roslavskiĭ.  Digital picture processing : an introduction , 1985 .

[10]  Tsachy Weissman,et al.  A discrete universal denoiser and its application to binary images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[11]  Suyash P. Awate,et al.  Image denoising with unsupervised, information-theoretic, adaptive filtering , 2004 .

[12]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Jean-Michel Morel,et al.  Self-Similarity Driven Color Demosaicking , 2009, IEEE Transactions on Image Processing.

[14]  Jean-Michel Morel,et al.  DA3D: Fast and data adaptive dual domain denoising , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[16]  Charles Kervrann,et al.  Local Adaptivity to Variable Smoothness for Exemplar-Based Image Regularization and Representation , 2008, International Journal of Computer Vision.

[17]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[18]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[19]  Jean-Michel Morel,et al.  A review of P.D.E. models in image processing and image analysis , 2002 .

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Tsachy Weissman,et al.  Universal discrete denoising: known channel , 2003, IEEE Transactions on Information Theory.

[22]  Matthias Zwicker,et al.  Dual-domain image denoising , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[24]  Luis Álvarez,et al.  The Size of Objects in Natural and Artificial Images , 1999 .

[25]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[26]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[27]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[28]  Vicent Caselles,et al.  Analysis of a Variational Framework for Exemplar-Based Image Inpainting , 2012, Multiscale Model. Simul..

[29]  Yann Gousseau,et al.  A Bias-Variance Approach for the Nonlocal Means , 2011, SIAM J. Imaging Sci..

[30]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[31]  Florence Tupin,et al.  Poisson NL means: Unsupervised non local means for Poisson noise , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[33]  Peyman Milanfar,et al.  Asymptotic Performance of Global Denoising , 2016, SIAM J. Imaging Sci..

[34]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[35]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[36]  I. Johnstone,et al.  Ideal denoising in an orthonormal basis chosen from a library of bases , 1994 .

[37]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[38]  Peyman Milanfar,et al.  Symmetrizing Smoothing Filters , 2013, SIAM J. Imaging Sci..

[39]  Jean-Michel Morel,et al.  Non-local dual image denoising , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[40]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[41]  Peyman Milanfar,et al.  Global denoising is asymptotically optimal , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[42]  Stanley H. Chan,et al.  Demystifying Symmetric Smoothing Filters , 2016, ArXiv.