Superpixel-based image noise variance estimation with local statistical assessment

Noise estimation is fundamental and essential in a wide variety of computer vision, image, and video processing applications. It provides an adaptive mechanism for many restoration algorithms instead of using fixed values for the setting of noise levels. This paper proposes a new superpixel-based framework associated with statistical analysis for estimating the variance of additive Gaussian noise in digital images. The proposed approach consists of three major phases: superpixel classification, local variance computation, and statistical determination. The normalized cut algorithm is first adopted to effectively divide the image into a set of superpixel regions, from which the noise variance is computed and estimated. Subsequently, the Jarque–Bera test is used to exclude regions that are not normally distributed. The smallest standard deviation in the remaining regions is finally selected as the estimation result. A wide variety of noisy images with various scenarios were used to evaluate this new noise estimation algorithm. Experimental results indicated that the proposed framework provides accurate estimations across various noise levels. Comparing with many state-of-the-art methods, our algorithm strikes a good compromise between low-level and high-level noise estimations. It is suggested that the proposed method is of potential in many computer vision, image, and video processing applications that require automation.

[1]  Adelio Salsano,et al.  Noise estimation in digital images using fuzzy processing , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Marcos Martín-Fernández,et al.  Automatic noise estimation in images using local statistics. Additive and multiplicative cases , 2009, Image Vis. Comput..

[3]  Shih-Ming Yang,et al.  A fast method for image noise estimation using Laplacian operator and adaptive edge detection , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[4]  Minghui Wang,et al.  Estimating Noise Parameter Based on the Wavelet Coefficients Estimation of Original Image , 2010, 2010 International Conference on Challenges in Environmental Science and Computer Engineering.

[5]  Anil K. Bera,et al.  Efficient tests for normality, homoscedasticity and serial independence of regression residuals , 1980 .

[6]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[7]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[8]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Yang Cao,et al.  Segmentation methods for noise level estimation and adaptive denoising from a single image , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[10]  Søren I. Olsen,et al.  Estimation of Noise in Images: An Evaluation , 1993, CVGIP Graph. Model. Image Process..

[11]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[13]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Zou Cheng-Jun,et al.  Entropy-based estimation of salt-pepper noise in wavelet domain , 2013, 2013 10th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[15]  Benjamin Pfaff,et al.  Handbook Of Image And Video Processing , 2016 .

[16]  Sangkeun Lee,et al.  Edge statistics-based image scale ratio and noise strength estimation in DCT-coded images , 2009, IEEE Transactions on Consumer Electronics.

[17]  Hong Kook Kim,et al.  Mechanical noise suppression based on non-negative matrix factorization and multi-band spectral subtraction for digital cameras , 2013, IEEE Transactions on Consumer Electronics.

[18]  K. M. Mohsin,et al.  Bilateral filtering with adaptation to phase coherence and noise , 2013, Signal Image Video Process..

[19]  Herng-Hua Chang,et al.  Entropy-based trilateral filtering for noise removal in digital images , 2010, 2010 3rd International Congress on Image and Signal Processing.

[20]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[21]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[22]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[23]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Lei Zheng,et al.  Fast noise variance estimation by principal component analysis , 2013, Electronic Imaging.

[25]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[26]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[27]  Roberto Rinaldo,et al.  Model-based global and local motion estimation for videoconference sequences , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Woei-Chyn Chu,et al.  Restoration algorithm for image noise removal using double bilateral filtering , 2012, J. Electronic Imaging.

[29]  R. Unbehauen,et al.  Estimation of image noise variance , 1999 .

[30]  Hui Fang,et al.  Joint Noise Level Estimation from Personal Photo Collections , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  J.S. Lee,et al.  Noise Modeling and Estimation of Remotely-Sensed Images , 1989, 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,.

[32]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Anil K. Bera,et al.  A test for normality of observations and regression residuals , 1987 .

[34]  Seungjoon Yang,et al.  Block-based noise estimation using adaptive Gaussian filtering , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[35]  Giuseppe Messina,et al.  Fast method for noise level estimation and integrated noise reduction , 2005, IEEE Transactions on Consumer Electronics.