Estimation of Gaussian, Poissonian–Gaussian, and Processed Visual Noise and Its Level Function

We propose a method for estimating the image and video noises of different types: white Gaussian (signal-independent), mixed Poissonian-Gaussian (signal-dependent), or processed (non-white). Our method also estimates the noise level function (NLF) of these types. We do so by classifying image patches based on their intensity and variance in order to find homogeneous regions that best represent the noise. We assume that the noise variance is a piecewise linear function of intensity in each intensity class. To find noise representative regions, noisy (signal-free) patches are first nominated in each intensity class. Next, clusters of connected patches are weighted, where the weights are calculated based on the degree of similarity to the noise model. The highest ranked cluster defines the peak noise variance, and other selected clusters are used to approximate the NLF. The more information we incorporate, such as temporal data and camera settings, the more reliable the estimation becomes. To account for the processed noise, (i.e., remaining after in-camera processing), we consider the ratio of low-to-high-frequency energies. We address noise variations along video signals using a temporal stabilization of the estimated noise. Objective and subjective simulations demonstrate that the proposed method outperforms other noise estimation techniques, both in accuracy and speed.

[1]  Seungjoon Yang,et al.  Block-based noise estimation using adaptive Gaussian filtering , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[2]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[3]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[4]  W. A. Mahmoud,et al.  Chapter 15: Estimation of Noise in Gray-Scale and Colored Images Using Median Absolute Deviation (MAD) , 2008, 2008 3rd International Conference on Geometric Modeling and Imaging.

[5]  Alessandro Foi,et al.  Practical denoising of clipped or overexposed noisy images , 2008, 2008 16th European Signal Processing Conference.

[6]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[7]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jing-Yu Yang,et al.  Estimation of signal-dependent sensor noise via sparse representation of noise level functions , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Jean-Michel Morel,et al.  Nonparametric Multiscale Blind Estimation of Intensity-Frequency-Dependent Noise , 2015, IEEE Transactions on Image Processing.

[10]  Soosan Beheshti,et al.  Adaptive Noise Variance Estimation in BayesShrink , 2010, IEEE Signal Processing Letters.

[11]  Mohammed Ghazal,et al.  Homogeneity Localization Using Particle Filters With Application to Noise Estimation , 2011, IEEE Transactions on Image Processing.

[12]  Qiang Chen,et al.  A new method for noise estimation in single-band remote sensing images , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[13]  Shih-Ming Yang,et al.  A fast method for image noise estimation using Laplacian operator and adaptive edge detection , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[14]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[16]  Lei Zheng,et al.  Image Noise Level Estimation by Principal Component Analysis , 2013, IEEE Transactions on Image Processing.

[17]  Takeo Kanade,et al.  Statistical Calibration of the CCD Imaging Process , 2001, ICCV.

[18]  Hugues Talbot,et al.  An EM Approach for Time-Variant Poisson-Gaussian Model Parameter Estimation , 2014, IEEE Transactions on Signal Processing.

[19]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[20]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[21]  A. Foi,et al.  Noise variance estimation in nonlocal transform domain , 2009, 2009 International Workshop on Local and Non-Local Approximation in Image Processing.

[22]  Meisam Rakhshanfar,et al.  Homogeneity classification for signal-dependent noise estimation in images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[23]  Eric Dubois,et al.  Fast and reliable structure-oriented video noise estimation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Zhenyu Xu,et al.  Noise Parameter Estimation for Poisson Corrupted Images Using Variance Stabilization Transforms , 2014, IEEE Transactions on Image Processing.

[26]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  William T. Freeman,et al.  A High-Quality Video Denoising Algorithm Based on Reliable Motion Estimation , 2010, ECCV.

[28]  Yuan F. Zheng,et al.  Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[30]  Qionghai Dai,et al.  Image and Video Denoising Using Adaptive Dual-Tree Discrete Wavelet Packets , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Shen-Chuan Tai,et al.  Fast and reliable image-noise estimation using a hybrid approach , 2010, J. Electronic Imaging.

[33]  Min-Cheol Hong,et al.  Filtering-Based Noise Estimation for Denoising the Image Degraded by Gaussian Noise , 2011, PSIVT.

[34]  Jean-Michel Morel,et al.  A non-parametric approach for the estimation of intensity-frequency dependent noise , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[35]  Jing Tian,et al.  Image Noise Estimation Using A Variation-Adaptive Evolutionary Approach , 2012, IEEE Signal Processing Letters.

[36]  Anil C. Kokaram,et al.  Measuring noise correlation for improved video denoising , 2012, 2012 19th IEEE International Conference on Image Processing.

[37]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.