A Self-supervised SAR Image Despeckling Strategy Based on Parameter-sharing Convolutional Neural Networks

Speckle noise is generated due to the SAR imaging mechanism, which brings difficulties in SAR image interpretation. Hence, despeckling is a helpful step in SAR pre-processing. Nowadays, deep learning has been proved to be a progressive method for SAR image despeckling. Most deep learning methods for despeckling are based on supervised learning, which needs original SAR images and speckle-free SAR images to train the network. However, the speckle-free SAR images are generally not available. So, this issue was tackled by adding multiplicative noise to optical images synthetically for simulating speckled image. Therefore, there are following challenges in SAR image despeckling: (1) lack of speckle-free SAR image; (2) difficulty in keeping details such as edges and textures in heterogeneous areas. To address these issues, we propose a self-supervised SAR despeckling strategy that can be trained without speckle-free images. Firstly, the feasibility of SAR image despeckling without speckle-free images is proved theoretically. Then, the sub-sampler based on the adjacent-syntropy criteria is proposed. The training image pairs are generated by the sub-sampler from real-word SAR image to estimate the noise distribution. Furthermore, to make full use of training pairs, the parameter sharing convolutional neural networks are adopted. Finally, according to the characteristics of SAR images, a multi-feature loss function is proposed. The proposed loss function is composed of despeckling term, regular term and perception term, to constrain the gap between the generated paired images. The ability of edge and texture feature preserving is improved simultaneously. Finally, qualitative and quantitative experiments are validated on real-world SAR images, showing better performances than several advanced SAR image despeckling methods.

[1]  Yulei Wu,et al.  An Advanced SAR Image Despeckling Method by Bernoulli-Sampling-Based Self-Supervised Deep Learning , 2021, Remote. Sens..

[2]  Dawid Połap,et al.  Automatic ship classification for a riverside monitoring system using a cascade of artificial intelligence techniques including penalties and rewards. , 2021, ISA transactions.

[3]  Xu Jia,et al.  Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Chen Wang,et al.  SAR Image Despeckling by Noisy Reference-Based Deep Learning Method , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Enrico Magli,et al.  Speckle2Void: Deep Self-Supervised SAR Despeckling With Blind-Spot Convolutional Neural Networks , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Davide Cozzolino,et al.  Nonlocal CNN SAR Image Despeckling , 2020, Remote. Sens..

[7]  Ye Yuan,et al.  Blind SAR Image Despeckling Using Self-Supervised Dense Dilated Convolutional Neural Network , 2019, ArXiv.

[8]  Loïc Royer,et al.  Noise2Self: Blind Denoising by Self-Supervision , 2019, ICML.

[9]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Sergey Voinov,et al.  Modelling ship detectability depending on TerraSAR-X-derived metocean parameters , 2018, CEAS Space Journal.

[11]  Wangmeng Zuo,et al.  Toward Convolutional Blind Denoising of Real Photographs , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[13]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[14]  Xiaoshuang Ma,et al.  Learning a Dilated Residual Network for SAR Image Despeckling , 2017, Remote. Sens..

[15]  Vishal M. Patel,et al.  SAR Image Despeckling Using a Convolutional Neural Network , 2017, IEEE Signal Processing Letters.

[16]  Davide Cozzolino,et al.  SAR image despeckling through convolutional neural networks , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[17]  B. Perumal,et al.  A survey on: De-speckling methods Of SAR image , 2016, 2016 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[18]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[19]  Domenico Velotto,et al.  First Comparison of Sentinel-1 and TerraSAR-X Data in the Framework of Maritime Targets Detection: South Italy Case , 2016, IEEE Journal of Oceanic Engineering.

[20]  Luisa Verdoliva,et al.  Benchmarking Framework for SAR Despeckling , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Luciano Alparone,et al.  A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images , 2013, IEEE Geoscience and Remote Sensing Magazine.

[22]  Luisa Verdoliva,et al.  A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[24]  Maoguo Gong,et al.  SAR Image Despeckling Based on Local Homogeneous-Region Segmentation by Using Pixel-Relativity Measurement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[25]  J. Jennifer Ranjani,et al.  Dual-Tree Complex Wavelet Transform Based SAR Despeckling Using Interscale Dependence , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[27]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[28]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[29]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[30]  Fawwaz T. Ulaby,et al.  Statistical properties of logarithmically transformed speckle , 2002, IEEE Trans. Geosci. Remote. Sens..

[31]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Stanley Osher,et al.  Multiplicative Denoising and Deblurring: Theory and Algorithms , 2003 .

[35]  Bin Yu,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).