Convolutional Neural Network with Median Layers for Denoising Salt-and-Pepper Contaminations

We propose a deep fully convolutional neural network with a new type of layer, named median layer, to restore images contaminated by the salt-and-pepper (s&p) noise. A median layer simply performs median filtering on all feature channels. By adding this kind of layer into some widely used fully convolutional deep neural networks, we develop an end-to-end network that removes the extremely high-level s&p noise without performing any non-trivial preprocessing tasks, which is different from all the existing literature in s&p noise removal. Experiments show that inserting median layers into a simple fully-convolutional network with the L2 loss significantly boosts the signal-to-noise ratio. Quantitative comparisons testify that our network outperforms the state-of-the-art methods with a limited amount of training data. The source code has been released for public evaluation and use (this https URL).

[1]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[2]  Julie Delon,et al.  PARIGI: a Patch-based Approach to Remove Impulse-Gaussian Noise from Images , 2016, Image Process. Line.

[3]  Fang Li,et al.  Denoising convolutional neural network with mask for salt and pepper noise , 2019, IET Image Process..

[4]  Yan Xing,et al.  Deep CNN for removal of salt and pepper noise , 2019, IET Image Process..

[5]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[6]  David Ebenezer,et al.  A New Fast and Efficient Decision-Based Algorithm for Removal of High-Density Impulse Noises , 2007, IEEE Signal Processing Letters.

[7]  Thomas S. Huang,et al.  A fast two-dimensional median filtering algorithm , 1979 .

[8]  Toshihiko Yamasaki,et al.  Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing , 2018, AAAI.

[9]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[10]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Zhiwei Xiong,et al.  Deep Boosting for Image Denoising , 2018, ECCV.

[12]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[13]  Justin Varghese,et al.  Adaptive Switching Non-local Filter for the Restoration of Salt and Pepper Impulse-Corrupted Digital Images , 2015 .

[14]  Wei Wang,et al.  An Efficient Switching Median Filter Based on Local Outlier Factor , 2011, IEEE Signal Processing Letters.

[15]  Yi Li,et al.  A convolutional neural networks denoising approach for salt and pepper noise , 2018, Multimedia Tools and Applications.

[16]  Xianming Liu,et al.  When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach , 2017, IJCAI.

[17]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Lianghai Jin,et al.  Learning deep CNNs for impulse noise removal in images , 2019, J. Vis. Commun. Image Represent..

[19]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[20]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.