Effective and Fast Estimation for Image Sensor Noise Via Constrained Weighted Least Squares

Noise estimation is crucial in many image processing algorithms such as image denoising. Conventionally, the noise is assumed as a signal-independent additive white Gaussian process. However, for the real raw data of image sensor, the present noise should be practically modeled as signal dependent. In this paper, we propose an effective and fast image sensor noise estimation method for a single raw image. The noise model parameters are estimated via constrained weighted least squares (WLS) fitting on a number of data samples, each of which is generated from a group of weakly textured patches. Specifically, we first design a fast scheme for selecting weakly textured patches, with the guidance of image histogram. To robustly fit the data samples, we then explicitly account for the credibility of each sample by measuring the texture strength of the grouped patches. The image sensor noise estimation is finally formulated as a constrained WLS optimization problem, which can be solved efficiently. Experimental results demonstrate that our method could run much faster than the existing schemes, while retaining the state-of-the-art estimation performance.

[1]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[2]  Xinhao Liu,et al.  Estimation of signal dependent noise parameters from a single image , 2013, 2013 IEEE International Conference on Image Processing.

[3]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Jürgen Hesser,et al.  Image Sensor Noise Parameter Estimation by Variance Stabilization and Normality Assessment , 2014, IEEE Transactions on Image Processing.

[5]  Alessandro Foi,et al.  Noise Parameter Mismatch in Variance Stabilization, With an Application to Poisson–Gaussian Noise Estimation , 2014, IEEE Transactions on Image Processing.

[6]  W. M. Hubbard,et al.  The approximation of a Poisson distribution by a Gaussian distribution , 1970 .

[7]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[8]  Kede Ma,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[9]  Yong Ho Moon,et al.  Simplified noise model parameter estimation for signal-dependent noise , 2014, Signal Process..

[10]  Vladimir V. Lukin,et al.  Image informative maps for component-wise estimating parameters of signal-dependent noise , 2013, J. Electronic Imaging.

[11]  Takahiro Okabe,et al.  Detecting Forgery From Static-Scene Video Based on Inconsistency in Noise Level Functions , 2010, IEEE Transactions on Information Forensics and Security.

[12]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[13]  Alan C. Bovik,et al.  Handbook of Image and Video Processing (Communications, Networking and Multimedia) , 2005 .

[14]  Xinhao Liu,et al.  Single-Image Noise Level Estimation for Blind Denoising , 2013, IEEE Transactions on Image Processing.

[15]  A.J. Blanksby,et al.  Noise performance of a color CMOS photogate image sensor , 1997, International Electron Devices Meeting. IEDM Technical Digest.

[16]  Paul L. Rosin Thresholding for change detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[18]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[19]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Guangtao Zhai,et al.  Noise Estimation of Natural Images via Statistical Analysis and Noise Injection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[22]  Xing Zhang,et al.  Exposing Region Splicing Forgeries with Blind Local Noise Estimation , 2013, International Journal of Computer Vision.

[23]  Li Dong,et al.  Noise Level Estimation for Natural Images Based on Scale-Invariant Kurtosis and Piecewise Stationarity , 2017, IEEE Transactions on Image Processing.

[24]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Xinhao Liu,et al.  Practical Signal-Dependent Noise Parameter Estimation From a Single Noisy Image , 2014, IEEE Transactions on Image Processing.

[26]  Michael K. Ng,et al.  Efficient Total Variation Minimization Methods for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[27]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[28]  Gerald Schaefer,et al.  UCID: an uncompressed color image database , 2003, IS&T/SPIE Electronic Imaging.

[29]  Alessandro Foi,et al.  Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise , 2013, IEEE Transactions on Image Processing.

[30]  Youngbae Hwang,et al.  Sensor noise modeling using the Skellam distribution: Application to the color edge detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  D. Ruppert,et al.  A Note on Computing Robust Regression Estimates via Iteratively Reweighted Least Squares , 1988 .

[32]  Dacheng Tao,et al.  Classification with Noisy Labels by Importance Reweighting , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[34]  Lei Zheng,et al.  Image Noise Level Estimation by Principal Component Analysis , 2013, IEEE Transactions on Image Processing.

[35]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.

[36]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[37]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Jaakko Astola,et al.  Improved method for blind estimation of the variance of mixed noise using weighted LMS line fitting algorithm , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.