A spatially cohesive superpixel model for image noise level estimation

Abstract Estimating image noise levels is a critical task for many image processing applications, where the detection of homogeneous regions always plays a key role. Most conventional methods empirically divide the images into rectangular blocks and then select the most homogeneous ones. However, this approach may result in erroneous homogeneity detection, especially in the case of highly textured images. To address this challenge, a spatially cohesive superpixel model is proposed in this paper, which can decompose a noisy image into patches that adhere to local structures and hence tend to exhibit increased homogeneity. A new similarity measure is also defined, to make the superpixel model more robust to noise. Combined with histogram-based homogeneous superpixel selection and filter-based noise level calculations, our method can accurately estimate the noise level of images with various noise intensities and different image complexities. Moreover, the method is extended to the signal-dependent noise case, which is usually the case of hyperspectral images. Experiments demonstrate that the proposed method outperforms the state-of-the-art methods.

[1]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  R. Unbehauen,et al.  Estimation of image noise variance , 1999 .

[3]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  John Immerkær,et al.  Fast Noise Variance Estimation , 1996, Comput. Vis. Image Underst..

[5]  Wei Liu,et al.  Dictionary Pair Learning on Grassmann Manifolds for Image Denoising , 2015, IEEE Transactions on Image Processing.

[6]  Jing Tian,et al.  Image Noise Estimation Using A Variation-Adaptive Evolutionary Approach , 2012, IEEE Signal Processing Letters.

[7]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  Soosan Beheshti,et al.  Adaptive Noise Variance Estimation in BayesShrink , 2010, IEEE Signal Processing Letters.

[9]  Meisam Rakhshanfar,et al.  Estimation of Gaussian, Poissonian–Gaussian, and Processed Visual Noise and Its Level Function , 2016, IEEE Transactions on Image Processing.

[10]  Shen-Chuan Tai,et al.  Fast and reliable image-noise estimation using a hybrid approach , 2010, J. Electronic Imaging.

[11]  Xiaowei Yang,et al.  A robust least squares support vector machine for regression and classification with noise , 2014, Neurocomputing.

[12]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Bo Fu,et al.  An image topic model for image denoising , 2015, Neurocomputing.

[14]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Lei Zheng,et al.  Image Noise Level Estimation by Principal Component Analysis , 2013, IEEE Transactions on Image Processing.

[17]  Seungjoon Yang,et al.  Block-based noise estimation using adaptive Gaussian filtering , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[18]  Marco Diani,et al.  Signal-Dependent Noise Modeling and Model Parameter Estimation in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Zhang Yi,et al.  Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering , 2012, IEEE Transactions on Cybernetics.

[20]  Zhi Xu,et al.  A two-stage image segmentation via global and local region active contours , 2016, Neurocomputing.

[21]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[22]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Shen-Chuan Tai,et al.  A design framework for hybrid approaches of image noise estimation and its application to noise reduction , 2012, J. Vis. Commun. Image Represent..

[24]  Caiming Zhang,et al.  Patch Grouping SVD-Based Denoising Aggregation Patch Grouping SVD-Based Denoising Aggregation Back Projection Noisy Image , 2015 .

[25]  Qian Wang,et al.  Hyperspectral Imagery Denoising Based on Oblique Subspace Projection , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Bo-Cai Gao,et al.  An operational method for estimating signal to noise ratios from data acquired with imaging spectrometers , 1993 .

[27]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[28]  Marcelo Bertalmío,et al.  A Decomposition Framework for Image Denoising Algorithms , 2016, IEEE Transactions on Image Processing.

[29]  Marcos Martín-Fernández,et al.  Automatic noise estimation in images using local statistics. Additive and multiplicative cases , 2009, Image Vis. Comput..

[30]  Ping Jiang,et al.  Fast and reliable noise level estimation based on local statistic , 2016, Pattern Recognit. Lett..

[31]  Aishy Amer,et al.  Fast and reliable structure-oriented video noise estimation , 2005 .

[32]  Wei-Yun Yau,et al.  Semi-supervised subspace learning with L2graph , 2016, Neurocomputing.

[33]  Qiang Chen,et al.  A new method for noise estimation in single-band remote sensing images , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[34]  Takayuki Hamamoto,et al.  Sensor-Pattern-Noise Map Reconstruction in Source Camera Identification for Size-Reduced Images , 2013, IEICE Trans. Inf. Syst..

[35]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[36]  Luciano Alparone,et al.  Signal-dependent noise modelling and estimation of new-generation imaging spectrometers , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.