Learning synthetic aperture radar image despeckling without clean data

Abstract. Speckle noise can reduce the image quality of synthetic aperture radar (SAR) and make interpretation more difficult. Existing SAR image despeckling convolutional neural networks require quantities of noisy–clean image pairs. However, obtaining clean SAR images is very difficult. Because continuous convolution and pooling operations result in losing many informational details while extracting the deep features of the SAR image, the quality of recovered clean images becomes worse. Therefore, we propose a despeckling network called multiscale dilated residual U-Net (MDRU-Net). The MDRU-Net can be trained directly using noisy–noisy image pairs without clean data. To protect more SAR image details, we design five multiscale dilated convolution modules that extract and fuse multiscale features. Considering that the deep and shallow features are very distinct in fusion, we design different dilation residual skip connections, which make features at the same level have the same convolution operations. Afterward, we present an effective L_hybrid loss function that can effectively improve the network stability and suppress artifacts in the predicted clean SAR image. Compared with the state-of-the-art despeckling algorithms, the proposed MDRU-Net achieves a significant improvement in several key metrics.

[1]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[2]  Chong Chen,et al.  Aerial-Image Denoising Based on Convolutional Neural Network with Multi-Scale Residual Learning Approach , 2018, Inf..

[3]  Nelson D. A. Mascarenhas,et al.  SAR Speckle Nonlocal Filtering With Statistical Modeling of Haar Wavelet Coefficients and Stochastic Distances , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[5]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[6]  Ke Li,et al.  MRD-Nets: Multi-Scale Residual Networks With Dilated Convolutions for Classification and Clustering Analysis of Spacecraft Electrical Signal , 2019, IEEE Access.

[7]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[8]  Xiao Xiang Zhu,et al.  The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[9]  Mohammad Javad Valadan Zoej,et al.  Adaptive method of speckle reduction based on curvelet transform and thresholding neural network in synthetic aperture radar images , 2015 .

[10]  Luisa Verdoliva,et al.  Benchmarking Framework for SAR Despeckling , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Saeid Homayouni,et al.  Hybrid SAR Speckle Reduction Using Complex Wavelet Shrinkage and Non-Local PCA-Based Filtering , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Vishal M. Patel,et al.  SAR Image Despeckling Using a Convolutional Neural Network , 2017, IEEE Signal Processing Letters.

[13]  Jong-Sen Lee,et al.  Speckle analysis and smoothing of synthetic aperture radar images , 1981 .

[14]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[15]  V. Chandrasekar,et al.  The Impact of Adaptive Speckle Filtering on Multi-Channel SAR Change Detection , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[16]  Cheng Wang,et al.  Multi-model SAR image despeckling , 2002 .

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Luca Brocca,et al.  Toward Global Soil Moisture Monitoring With Sentinel-1: Harnessing Assets and Overcoming Obstacles , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Sedigheh Ghofrani,et al.  Using two coefficients modeling of nonsubsampled Shearlet transform for despeckling , 2016 .

[21]  Ting Liu,et al.  Unsupervised Total Variation Loss for Semi-supervised Deep Learning of Semantic Segmentation , 2016, ArXiv.

[22]  Patrick Wambacq,et al.  Speckle filtering of synthetic aperture radar images : a review , 1994 .

[23]  C. Khatri Classical Statistical Analysis Based on a Certain Multivariate Complex Gaussian Distribution , 1965 .

[24]  Mihai Datcu,et al.  Huber–Markov Model for Complex SAR Image Restoration , 2010, IEEE Geoscience and Remote Sensing Letters.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Davide Cozzolino,et al.  SAR image despeckling through convolutional neural networks , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[28]  Florence Tupin,et al.  MuLoG: A Generic Variance-Stabilization Approach for Speckle Reduction in SAR Interferometry and SAR Polarimetry , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[29]  Yu-Bin Yang,et al.  Image Denoising Using Very Deep Fully Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, ArXiv.

[30]  Achim Roth,et al.  Assessing Single-Polarization and Dual-Polarization TerraSAR-X Data for Surface Water Monitoring , 2018, Remote. Sens..

[31]  Luciano Alparone,et al.  A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images , 2013, IEEE Geoscience and Remote Sensing Magazine.

[32]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[33]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[35]  Xiaoshuang Ma,et al.  Learning a Dilated Residual Network for SAR Image Despeckling , 2017, Remote. Sens..

[36]  Guangming Shi,et al.  A Convolutional Encoder-Decoder Network With Skip Connections for Saliency Prediction , 2019, IEEE Access.

[37]  E. Nezry,et al.  Adaptive speckle filters and scene heterogeneity , 1990 .

[38]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[39]  Matteo Matteucci,et al.  Deep Learning for SAR Image Despeckling , 2019, Remote. Sens..

[40]  Weisi Lin,et al.  A Dilated Inception Network for Visual Saliency Prediction , 2019, IEEE Transactions on Multimedia.

[41]  Tong Tong,et al.  Image Super-Resolution Using Dense Skip Connections , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[42]  J.S. Lee,et al.  Polarimetric SAR speckle filtering and its impact on classification , 1997, IGARSS'97. 1997 IEEE International Geoscience and Remote Sensing Symposium Proceedings. Remote Sensing - A Scientific Vision for Sustainable Development.

[43]  Katsumi Tadamura,et al.  An efficient orthorectification of a satellite SAR image used for monitoring occurrence of disaster , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[44]  Cheolkon Jung,et al.  DCSR: Dilated Convolutions for Single Image Super-Resolution , 2019, IEEE Transactions on Image Processing.

[45]  Huaping Xu,et al.  Denoising method based on intrascale correlation in nonsubsampled contourlet transform for synthetic aperture radar images , 2019, Journal of Applied Remote Sensing.

[46]  Thomas L. Ainsworth,et al.  Improved Sigma Filter for Speckle Filtering of SAR Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Luisa Verdoliva,et al.  A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Jie Yang,et al.  Adaptive-Window Polarimetric SAR Image Speckle Filtering Based on a Homogeneity Measurement , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Luisa Verdoliva,et al.  Exploiting Patch Similarity for SAR Image Processing: The nonlocal paradigm , 2014, IEEE Signal Processing Magazine.

[51]  Ivan Ostroumov,et al.  An Investigation of Synthetic Aperture Radar Speckle Filtering and Image Segmentation Considering Wavelet Decomposition , 2019, 2019 European Microwave Conference in Central Europe (EuMCE).

[52]  Gangyao Kuang,et al.  Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[53]  Davide Cozzolino,et al.  Guided Patchwise Nonlocal SAR Despeckling , 2018, IEEE Transactions on Geoscience and Remote Sensing.