From Heuristic Optimization to Dictionary Learning: A Review and Comprehensive Comparison of Image Denoising Algorithms

Image denoising is a well explored topic in the field of image processing. In the past several decades, the progress made in image denoising has benefited from the improved modeling of natural images. In this paper, we introduce a new taxonomy based on image representations for a better understanding of state-of-the-art image denoising techniques. Within each category, several representative algorithms are selected for evaluation and comparison. The experimental results are discussed and analyzed to determine the overall advantages and disadvantages of each category. In general, the nonlocal methods within each category produce better denoising results than local ones. In addition, methods based on overcomplete representations using learned dictionaries perform better than others. The comprehensive study in this paper would serve as a good reference and stimulate new research ideas in image denoising.

[1]  Shu-Mei Guo,et al.  Genetic-based fuzzy image filter and its application to image processing , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Xuelong Li,et al.  Multi-scale dictionary for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Thierry Blu,et al.  SURE-LET for Orthonormal Wavelet-Domain , 2010 .

[4]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[5]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[6]  Aggelos K. Katsaggelos,et al.  Noise reduction filters for dynamic image sequences: a review , 1995, Proc. IEEE.

[7]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[8]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[9]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[10]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[11]  Javier Portilla,et al.  Deblurring-by-Denoising using Spatially Adaptive Gaussian Scale Mixtures in Overcomplete Pyramids , 2006, 2006 International Conference on Image Processing.

[12]  Peyman Milanfar,et al.  Clustering-Based Denoising With Locally Learned Dictionaries , 2009, IEEE Transactions on Image Processing.

[13]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[14]  D. Donoho.  Wedgelets: nearly minimax estimation of edges , 1999 .

[15]  A. Baudes,et al.  A Nonlocal Algorithm for Image Denoising , 2005, CVPR 2005.

[16]  Luc Brun,et al.  Non-local image smoothing by applying anisotropic diffusion PDE's in the space of patches , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[17]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[18]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[19]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  Joseph F. Murray,et al.  Dictionary Learning Algorithms for Sparse Representation , 2003, Neural Computation.

[21]  Stéphane Mallat,et al.  Bandelet Image Approximation and Compression , 2005, Multiscale Model. Simul..

[22]  J. Weickert,et al.  A ROTATIONALLY INVARIANT BLOCK MATCHING STRATEGY IMPROVING IMAGE DENOISING WITH NON-LOCAL MEANS , 2008 .

[23]  S. Mallat,et al.  Orthogonal bandelet bases for geometric images approximation , 2008 .

[24]  Oscar C. Au,et al.  A fast NL-Means method in image denoising based on the similarity of spatially sampled pixels , 2009, 2009 IEEE International Workshop on Multimedia Signal Processing.

[25]  Joachim Weickert,et al.  Rotationally invariant similarity measures for nonlocal image denoising , 2011, J. Vis. Commun. Image Represent..

[26]  Edward H. Adelson,et al.  Noise removal via Bayesian wavelet coring , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[27]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[28]  Sung-Bae Cho,et al.  A Novel Evolutionary Approach to Image Enhancement Filter Design: Method and Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  J.B.T.M. Roerdink,et al.  A review of wavelet denoising in MRI and ultrasound brain imaging , 2006 .

[30]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[31]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[32]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[33]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Jie Wei,et al.  Lebesgue anisotropic image denoising , 2005, Int. J. Imaging Syst. Technol..

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[37]  Anand Rangarajan,et al.  Image Denoising Using the Higher Order Singular Value Decomposition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[39]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[40]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[41]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[42]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[43]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[44]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[45]  J. Boulanger,et al.  Local adaptivity to variable smoothness for exemplar-based image denoising and representation , 2005 .

[46]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[47]  Guang-Zhong Yang,et al.  Structure adaptive anisotropic filtering , 1995 .

[48]  Gabriel Peyré,et al.  A Review of Adaptive Image Representations , 2011, IEEE Journal of Selected Topics in Signal Processing.

[49]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[50]  Ling Shao,et al.  Nonlocal Hierarchical Dictionary Learning Using Wavelets for Image Denoising , 2013, IEEE Transactions on Image Processing.

[51]  C.-C. Jay Kuo,et al.  Improved image denoising with adaptive nonlocal means (ANL-means) algorithm , 2010, IEEE Transactions on Consumer Electronics.

[52]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[53]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.

[54]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[55]  Stefano Soatto,et al.  Nonlocal Similarity Image Filtering , 2009, ICIAP.

[56]  Jean Ponce,et al.  Task-Driven Dictionary Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Rémi Gribonval,et al.  Learning unions of orthonormal bases with thresholded singular value decomposition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[58]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[59]  Bernard Widrow,et al.  Least-mean-square adaptive filters , 2003 .

[60]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  Ruomei Yan,et al.  Improved Nonlocal Means Based on Pre-Classification and Invariant Block Matching , 2012, Journal of Display Technology.

[62]  Jung-Hua Wang,et al.  Histogram-based fuzzy filter for image restoration , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[63]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[64]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[65]  Thierry Blu,et al.  A New SURE Approach to Image Denoising: Interscale Orthonormal Wavelet Thresholding , 2007, IEEE Transactions on Image Processing.

[66]  E. Candès,et al.  Recovering edges in ill-posed inverse problems: optimality of curvelet frames , 2002 .

[67]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[68]  D. L. Donoho,et al.  Ideal spacial adaptation via wavelet shrinkage , 1994 .

[69]  Jin Wang,et al.  Fast Non-Local Algorithm for Image Denoising , 2006, 2006 International Conference on Image Processing.

[70]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[71]  Gerard de Haan,et al.  An Overview and Performance Evaluation of Classification-Based Least Squares Trained Filters , 2008, IEEE Transactions on Image Processing.

[72]  Parametric Regularization,et al.  Adaptive Kernel-Based Image Denoising Employing Semi- , 2012 .

[73]  Aleksandra Pizurica,et al.  An improved non-local denoising algorithm , 2008 .