A fast yet reliable noise level estimation algorithm using shallow CNN-based noise separator and BP network

To date, a large number of research works have been conducted on noise level estimation (NLE) that automatically and accurately estimates the unknown noise level for an observed noisy image. Nevertheless, the state-of-the-art NLE algorithms are still limited in efficiency, which will undermine the overall execution performance of the subsequent denoiser. By making full use of the powerful nonlinear modeling capabilities of convolutional neural networks (CNNs), a shallow CNN-based noise separator with high execution efficiency for natural images was proposed to obtain the coarse noise component (difference image) from a single observed noisy image. Based on the fact that the coarse noise component tends to follow a Gaussian-like distribution, we chose to model it with the generalized Gaussian distribution model, whose parameters are strongly sensitive to noise level and can be treated as features to characterize the degradation degree of a given noisy image. As such, the extracted features were instantly mapped to their corresponding noise level via a back-propagation (BP) neural network pre-trained on the representative training samples, resulting in a fast yet reliable NLE algorithm. Experiments demonstrate that our training-based NLE algorithm exploiting the shallow CNN-based noise separator and BP network outperforms the state-of-the-art counterparts on estimating noise level with the least executing time over a wide range of image contents and noise levels, providing a highly effective solution to blind denoising as the preprocessing module of a non-blind denoiser.

[1]  Shaoping Xu,et al.  Fast Noise Level Estimation Algorithm Based on Two-Stage Support Vector Regression , 2018 .

[2]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[4]  Jean-François Aujol,et al.  Estimation of the Noise Level Function Based on a Nonparametric Detection of Homogeneous Image Regions , 2015, SIAM J. Imaging Sci..

[5]  Shen-Chuan Tai,et al.  A design framework for hybrid approaches of image noise estimation and its application to noise reduction , 2012, J. Vis. Commun. Image Represent..

[6]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Peng Wen-Yi,et al.  Research on Optimization and Implementation of BP Neural Network Algorithm , 2014, 2014 7th International Conference on Intelligent Computation Technology and Automation.

[8]  Jean-Michel Morel,et al.  Nonparametric noise estimation method for raw images. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Shaoping Xu,et al.  A Two-Stage Noise Level Estimation Using Automatic Feature Extraction and Mapping Model , 2019, IEEE Signal Processing Letters.

[10]  Meisam Rakhshanfar,et al.  Estimation of Gaussian, Poissonian–Gaussian, and Processed Visual Noise and Its Level Function , 2016, IEEE Transactions on Image Processing.

[11]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[12]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[13]  Xinhao Liu,et al.  Single-Image Noise Level Estimation for Blind Denoising , 2013, IEEE Transactions on Image Processing.

[14]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[15]  Li Dong,et al.  Noise Level Estimation for Natural Images Based on Scale-Invariant Kurtosis and Piecewise Stationarity , 2017, IEEE Transactions on Image Processing.

[16]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[17]  Jian Sun,et al.  BM3D-Net: A Convolutional Neural Network for Transform-Domain Collaborative Filtering , 2018, IEEE Signal Processing Letters.

[18]  Lei Zheng,et al.  Image Noise Level Estimation by Principal Component Analysis , 2013, IEEE Transactions on Image Processing.

[19]  Guangyong Chen,et al.  An Efficient Statistical Method for Image Noise Level Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[21]  Praful Gupta,et al.  Natural Scene Statistics for Noise Estimation , 2018, 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[22]  Wei-Yun Yau,et al.  Semi-supervised subspace learning with L2graph , 2016, Neurocomputing.

[23]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[24]  John Immerkær,et al.  Fast Noise Variance Estimation , 1996, Comput. Vis. Image Underst..