Three Approaches to Improve Denoising Results that Do Not Involve Developing New Denoising Methods

Image denoising has been a topic extensively investigated over the last three decades and, as repeatedly shown in this book, denoising algorithms have become incredibly good, so much so that many researchers have started questioning the need to further pursue this line of research. In this chapter, we argue that there is indeed room for improvement of denoising results, and we propose three different avenues to explore, none of which requires the development of new denoising methods. First, we describe how it can be better to denoise a transform of the noisy image rather than denoise the noisy image directly. We mention several possible transforms, and an open problem is to find a transform that is optimal for denoising, according to a proper image quality metric. Next, we point out the importance of having a proper noise model for JPEG pictures, so that a variance stabilization transform can be developed that transforms noise in JPEG images into additive white Gaussian noise, enabling existing denoising methods to be properly applied to the JPEG case. Finally, we highlight the fact that while virtually all denoising methods are optimized and validated in terms of the PSNR or SSIM measures, these metrics are not well correlated with perceived image quality, and therefore, it could be best to optimize the parameter values of denoising methods according to subjective testing. A remaining challenge is to develop perceptually based image quality metrics that match observer preference.

[1]  Marcelo Bertalmío,et al.  Generalized Gradient on Vector Bundle - Application to Image Denoising , 2013, SSVM.

[2]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[3]  Marcelo Bertalmío,et al.  A Decomposition Framework for Image Denoising Algorithms , 2016, IEEE Transactions on Image Processing.

[4]  Tamara Seybold,et al.  Local denoising applied to RAW images may outperform non-local patch-based methods applied to the camera output , 2016, Digital Photography and Mobile Imaging.

[5]  Hiroyuki Kobayashi,et al.  Analysis of sharpness increase by image noise , 2009, Electronic Imaging.

[6]  Rita Noumeir,et al.  Limitations of the SSIM quality metric in the context of diagnostic imaging , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[7]  Yasuyuki Matsushita,et al.  A Holistic Approach to Cross-Channel Image Noise Modeling and Its Application to Image Denoising , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[9]  Frédo Durand,et al.  Patch Complexity, Finite Pixel Correlations and Optimal Denoising , 2012, ECCV.

[10]  Yoshitsugu Manabe,et al.  Digital image improvement by adding noise: an example by a professional photographer , 2008, Electronic Imaging.

[11]  Stefan Roth,et al.  Benchmarking Denoising Algorithms with Real Photographs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Alessandro Foi,et al.  Ieee Transactions on Image Processing a Closed-form Approximation of the Exact Unbiased Inverse of the Anscombe Variance-stabilizing Transformation , 2022 .

[13]  Marcelo Bertalmío,et al.  Denoising an Image by Denoising Its Curvature Image , 2014, SIAM J. Imaging Sci..

[14]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[15]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[16]  Marcelo Bertalmío,et al.  On Covariant Derivatives and Their Applications to Image Regularization , 2014, SIAM J. Imaging Sci..

[17]  Marc Lebrun,et al.  An Analysis and Implementation of the BM3D Image Denoising Method , 2012, Image Process. Line.

[18]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[19]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[20]  Thomas Batard,et al.  Spinor Fourier Transform for Image Processing , 2013, IEEE Journal of Selected Topics in Signal Processing.

[21]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[22]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[23]  Michel Barlaud,et al.  Two deterministic half-quadratic regularization algorithms for computed imaging , 1994, Proceedings of 1st International Conference on Image Processing.

[24]  R. Zhang,et al.  The dominance of Poisson noise in color digital cameras , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Xue-Cheng Tai,et al.  Noise removal using smoothed normals and surface fitting , 2004, IEEE Transactions on Image Processing.

[26]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[27]  Talal Rahman,et al.  A TV-Stokes Denoising Algorithm , 2007, SSVM.

[28]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[29]  Michael Elad,et al.  Boosting of Image Denoising Algorithms , 2015, SIAM J. Imaging Sci..

[30]  Alessandro Foi,et al.  Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise , 2013, IEEE Transactions on Image Processing.

[31]  Jean-Michel Morel,et al.  The noise clinic: A universal blind denoising algorithm , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[32]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Alfred M. Bruckstein,et al.  Orientation-Matching Minimization for Image Denoising and Inpainting , 2011, International Journal of Computer Vision.

[34]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[35]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[36]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  V Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: experiments. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[39]  David Kane,et al.  Local denoising based on curvature smoothing can visually outperform non-local methods on photographs with actual noise , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[40]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[41]  Jean-Michel Morel,et al.  Non-Local Means Denoising , 2011, Image Process. Line.