A 3-D Atrous Convolution Neural Network for Hyperspectral Image Denoising

Deep learning, especially a discriminative model for image denoising, has shown great potential in removing complex spectral–spatial noise in hyperspectral images (HSI). For HSI denoising, it is crucial to extract more context information around each pixel and to predict each pixel according to the surrounding context. Therefore, the effective receptive field plays an important role when performing denoising task. Generally, an HSI denoising model can achieve better performance by reserving the correlation of adjacent spectral bands and extracting more pixel features in the spatial domain. In this paper, 3-D atrous denoising convolution neural network (3DADCNN) is proposed for HSI. The model extracts feature maps along both spatial and spectral dimensions and enlarges the receptive field without significantly increasing the number of network parameters. Simultaneously, the multibranch and multiscale structure is utilized to reduce training difficulty, lessen overfitting risk, and preserve details in texture. The proposed model can be applied to the corrupted image with a mixed type of photon and thermal noise. Experimental results of the quantitative and qualitative evaluation show that 3DADCNN outperforms state-of-the-art HSI denoising methods.

[1]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[2]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[4]  Yunsong Li,et al.  Hyperspectral Imagery Denoising by Deep Learning With Trainable Nonlinearity Function , 2017, IEEE Geoscience and Remote Sensing Letters.

[5]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Quanzheng Li,et al.  A Cascaded Convolutional Nerual Network for X-ray Low-dose CT Image Denoising , 2017, ArXiv.

[7]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[8]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Wei Liu,et al.  ParseNet: Looking Wider to See Better , 2015, ArXiv.

[10]  Shuchang Zhou,et al.  Exploiting Local Structures with the Kronecker Layer in Convolutional Networks , 2015, ArXiv.

[11]  Johannes R. Sveinsson,et al.  Wavelet-Based Sparse Reduced-Rank Regression for Hyperspectral Image Restoration , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Xianming Liu,et al.  When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach , 2017, IJCAI.

[13]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[14]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[15]  Salah Bourennane,et al.  Multidimensional wiener filtering using fourth order statistics of hyperspectral images , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Yueting Zhuang,et al.  Deep Convolutional Neural Networks with Merge-and-Run Mappings , 2016, IJCAI.

[17]  Ruogu Fang,et al.  Wide Inference Network for Image Denoising , 2017, ArXiv.

[18]  Guangyi Chen,et al.  Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Xiaoou Tang,et al.  Compression Artifacts Reduction by a Deep Convolutional Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[23]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[24]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[25]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[27]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[30]  Qi Wang,et al.  Noise reduction of hyperspectral imagery using nonlocal sparse representation with spectral-spatial structure , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[31]  Jie Li,et al.  Hyperspectral image recovery employing a multidimensional nonlocal total variation model , 2015, Signal Process..

[32]  Yu-Bin Yang,et al.  Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections , 2016, ArXiv.

[33]  Yi Shen,et al.  Structure tensor total variation-regularized weighted nuclear norm minimization for hyperspectral image mixed denoising , 2017, Signal Process..

[34]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[36]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[37]  Yunsong Li,et al.  Hyperspectral image super-resolution using deep convolutional neural network , 2017, Neurocomputing.

[38]  Alexander F. H. Goetz,et al.  Determination of semi-arid landscape endmembers and seasonal trends using convex geometry spectral unmixing techniques , 1993 .

[39]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Caroline Fossati,et al.  Reduction of Signal-Dependent Noise From Hyperspectral Images for Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[42]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[43]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[44]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Chein-I. Chang.  Hyperspectral Data Exploitation: Theory and Applications , 2007 .

[47]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[48]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Adam Krzyzak,et al.  Denoising of Three Dimensional Data Cube Using Bivariate Wavelet Shrinking , 2010, ICIAR.

[50]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[51]  Minchao Ye,et al.  Hyperspectral Imagery Restoration Using Nonlocal Spectral-Spatial Structured Sparse Representation With Noise Estimation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[52]  Qiang Zhang,et al.  Hyperspectral Image Denoising Employing a Spatial–Spectral Deep Residual Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Pierrick Coupé,et al.  Author manuscript, published in "Journal of Magnetic Resonance Imaging 2010;31(1):192-203" DOI: 10.1002/jmri.22003 Adaptive Non-Local Means Denoising of MR Images with Spatially Varying Noise Levels , 2010 .

[54]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[55]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[58]  Shen-En Qian,et al.  Noise reduction of hyperspectral imagery using hybrid spatial-spectral derivative-domain wavelet shrinkage , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Sheng Zhong,et al.  HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Xin Huang,et al.  Hyperspectral image noise reduction based on rank-1 tensor decomposition , 2013 .

[61]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[62]  Caroline Fossati,et al.  Denoising of Hyperspectral Images Using the PARAFAC Model and Statistical Performance Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[64]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[65]  Chunjiang Zhao,et al.  Fast detection and visualization of early decay in citrus using Vis-NIR hyperspectral imaging , 2016, Comput. Electron. Agric..