Anisotropic Nonlocal Means Denoising

It has recently been proved that the popular nonlocal means (NLM) denoising algorithm does not optimally denoise images with sharp edges. Its weakness lies in the isotropic nature of the neighborhoods it uses to set its smoothing weights. In response, in this paper we introduce several theoretical and practical anisotropic nonlocal means (ANLM) algorithms and prove that they are near minimax optimal for edge-dominated images from the Horizon class. On real-world test images, an ANLM algorithm that adapts to the underlying image gradients outperforms NLM by a significant margin.

[1]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[2]  M. Nagao,et al.  Edge preserving smoothing , 1979 .

[3]  Laurent Jacques,et al.  A panorama on multiscale geometric representations, intertwining spatial, directional and frequency selectivity , 2011, Signal Process..

[4]  D. Donoho.  Wedgelets: nearly minimax estimation of edges , 1999 .

[5]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[7]  Stéphane Mallat,et al.  Geometrical image estimation with orthogonal bandlet bases , 2007, SPIE Optical Engineering + Applications.

[8]  Jaakko Astola,et al.  Adaptive window size image denoising based on ICI rule , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[9]  Edward Wilson,et al.  A characterization of the higher dimensional groups associated with continuous wavelets , 2002 .

[10]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.

[11]  Andrew G. Glen,et al.  APPL , 2001 .

[12]  Justin K. Romberg,et al.  Wavelet-domain approximation and compression of piecewise smooth images , 2006, IEEE Transactions on Image Processing.

[13]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[14]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Generalised Nonlocal Image Smoothing Generalised Nonlocal Image Smoothing , 2022 .

[15]  David Tschumperlé,et al.  Fast Anisotropic Smoothing of Multi-Valued Images using Curvature-Preserving PDE's , 2006, International Journal of Computer Vision.

[16]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[17]  W. L. Ngai.  MSc Thesis , 2015 .

[18]  Kostadin Dabov,et al.  A NONLOCAL AND SHAPE-ADAPTIVE TRANSFORM-DOMAIN COLLABORATIVE FILTERING , 2008 .

[19]  Rebecca Willett,et al.  Oracle Inequalities and Minimax Rates for Nonlocal Means and Related Adaptive Kernel-Based Methods , 2011, SIAM J. Imaging Sci..

[20]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[22]  Mehran Ebrahimi,et al.  Efficient nonlocal-means denoising using the SVD , 2008, 2008 15th IEEE International Conference on Image Processing.

[23]  Aude Billard,et al.  Iterative Estimation of Rigid-Body Transformations , 2011, Journal of Mathematical Imaging and Vision.

[24]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[25]  Arian Maleki,et al.  Rate-Distortion Analysis of Directional Wavelets , 2012, IEEE Transactions on Image Processing.

[26]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[27]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[28]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[29]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[30]  Robert Hummel,et al.  Reconstructions from zero crossings in scale space , 1989, IEEE Trans. Acoust. Speech Signal Process..

[31]  E. Candès,et al.  Ridgelets: a key to higher-dimensional intermittency? , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[32]  Baltasar Beferull-Lozano,et al.  Directionlets: anisotropic multidirectional representation with separable filtering , 2006, IEEE Transactions on Image Processing.

[33]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[34]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[35]  P. Milanfar,et al.  Multiscale principal components analysis for image local orientation estimation , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[36]  A. Tsybakov,et al.  Minimax theory of image reconstruction , 1993 .

[37]  B. Krauskopf,et al.  Proc of SPIE , 2003 .

[38]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[39]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering , 2013 .

[40]  Demetrio Labate,et al.  Optimally Sparse Multidimensional Representation Using Shearlets , 2007, SIAM J. Math. Anal..

[41]  Stanley Osher,et al.  Deblurring and Denoising of Images by Nonlocal Functionals , 2005, Multiscale Model. Simul..

[42]  Yann Gousseau,et al.  A Bias-Variance Approach for the Nonlocal Means , 2011, SIAM J. Imaging Sci..

[43]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[44]  Richard G. Baraniuk,et al.  Suboptimality of nonlocal means on images with sharp edges , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[45]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[46]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[47]  Ericka Stricklin-Parker,et al.  Ann , 2005 .

[48]  Jain Bimi,et al.  Digital Image Processing - An Introduction , 2013 .

[49]  CONSTRUCTION OF REGULAR AND IRREGULAR SHEARLET FRAMES , 2007 .

[50]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[51]  C. Stein.  Approximate computation of expectations , 1986 .

[52]  D. Donoho,et al.  Does median filtering truly preserve edges better than linear filtering , 2006, math/0612422.

[53]  E. Candès,et al.  Recovering edges in ill-posed inverse problems: optimality of curvelet frames , 2002 .

[54]  Johan Wiklund,et al.  Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[56]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[57]  Michael T. Orchard,et al.  Edge directed prediction for lossless compression of natural images , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[58]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[59]  Robert D. Nowak,et al.  Multiscale Poisson Intensity and Density Estimation , 2007, IEEE Transactions on Information Theory.

[60]  Charles-Alban Deledalle,et al.  Non-local Methods with Shape-Adaptive Patches (NLM-SAP) , 2012, Journal of Mathematical Imaging and Vision.

[61]  Dimitri Van De Ville,et al.  SURE-Based Non-Local Means , 2009, IEEE Signal Processing Letters.

[62]  Ron Kimmel,et al.  Orientation Diffusion or How to Comb a Porcupine , 2002, J. Vis. Commun. Image Represent..

[63]  Robert D. Nowak,et al.  Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging , 2003, IEEE Transactions on Medical Imaging.

[64]  Joachim Weickert,et al.  Rotationally invariant similarity measures for nonlocal image denoising , 2011, J. Vis. Commun. Image Represent..

[65]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[66]  Yann Strozecki,et al.  From patches to pixels in Non-Local methods: Weighted-average reprojection , 2010, 2010 IEEE International Conference on Image Processing.

[67]  David A. Clausi,et al.  A perceptually adaptive approach to image denoising using anisotropic non-local means , 2008, 2008 15th IEEE International Conference on Image Processing.