Fast separable nonlocal means

Abstract. We propose a simple and fast algorithm called PatchLift for computing distances between patches (contiguous block of samples) extracted from a given one-dimensional signal. PatchLift is based on the observation that the patch distances can be efficiently computed from a matrix that is derived from the one-dimensional signal using lifting; importantly, the number of operations required to compute the patch distances using this approach does not scale with the patch length. We next demonstrate how PatchLift can be used for patch-based denoising of images corrupted with Gaussian noise. In particular, we propose a separable formulation of the classical nonlocal means (NLM) algorithm that can be implemented using PatchLift. We demonstrate that the PatchLift-based implementation of separable NLM is a few orders faster than standard NLM and is competitive with existing fast implementations of NLM. Moreover, its denoising performance is shown to be consistently superior to that of NLM and some of its variants, both in terms of peak signal-to-noise ratio/structural similarity index and visual quality.

[1]  C.-C. Jay Kuo,et al.  Fast Non-Local Means (NLM) Computation With Probabilistic Early Termination , 2010, IEEE Signal Processing Letters.

[2]  Thierry Blu,et al.  The SURE-LET Approach to Image Denoising , 2007, IEEE Transactions on Image Processing.

[3]  Andrew Adams,et al.  Fast High‐Dimensional Filtering Using the Permutohedral Lattice , 2010, Comput. Graph. Forum.

[4]  Yue Wu,et al.  Probabilistic Non-Local Means , 2013, IEEE Signal Processing Letters.

[5]  C. Stein.  Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[8]  Patrenahalli M. Narendra,et al.  A Separable Median Filter for Image Noise Smoothing , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jérôme Darbon,et al.  Fast nonlocal filtering applied to electron cryomicroscopy , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Lucas J. van Vliet,et al.  Separable bilateral filtering for fast video preprocessing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[11]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[12]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Mehran Ebrahimi,et al.  Efficient nonlocal-means denoising using the SVD , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Tolga Tasdizen,et al.  Principal Neighborhood Dictionaries for Nonlocal Means Image Denoising , 2009, IEEE Transactions on Image Processing.

[15]  Subhasis Chaudhuri,et al.  Novel Speed-Up Strategies for Non-Local Means Denoising With Patch and Edge Patch Based Dictionaries , 2014, IEEE Transactions on Image Processing.

[16]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[17]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[18]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[19]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[20]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[21]  Dimitri Van De Ville,et al.  SURE-Based Non-Local Means , 2009, IEEE Signal Processing Letters.

[22]  Wilfried Philips,et al.  A fast non-local image denoising algorithm , 2008, Electronic Imaging.

[23]  Mithun Uliyar,et al.  Fast Non-Local algorithm for image denoising , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[24]  Michael Unser,et al.  Fast $O(1)$ Bilateral Filtering Using Trigonometric Range Kernels , 2011, IEEE Transactions on Image Processing.

[25]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Chang-Yeong Kim,et al.  Separable bilateral nonlocal means , 2011, 2011 18th IEEE International Conference on Image Processing.

[27]  Charles-Alban Deledalle,et al.  Non-local Methods with Shape-Adaptive Patches (NLM-SAP) , 2012, Journal of Mathematical Imaging and Vision.

[28]  R. Deriche.  Recursively Implementing the Gaussian and its Derivatives , 1993 .

[29]  Jean-Michel Morel,et al.  Image Denoising Methods. A New Nonlocal Principle , 2010, SIAM Rev..

[30]  Peyman Milanfar,et al.  Patch-Based Near-Optimal Image Denoising , 2012, IEEE Transactions on Image Processing.

[31]  Laurent Condat.  A Simple Trick to Speed Up and Improve the Non-Local Means , 2010 .

[32]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[33]  Lucas J. van Vliet,et al.  Recursive implementation of the Gaussian filter , 1995, Signal Process..

[34]  Tolga Tasdizen.  Principal components for non-local means image denoising , 2008, 2008 15th IEEE International Conference on Image Processing.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  M. Levoy,et al.  Gaussian KD-trees for fast high-dimensional filtering , 2009, SIGGRAPH 2009.