NN-Based Prediction of Sentinel-1 SAR Image Filtering Efficiency

Images acquired by synthetic aperture radars are degraded by speckle that prevents efficient extraction of useful information from radar remote sensing data. Filtering or despeckling is a tool often used to improve image quality. However, depending upon image and noise properties, the quality of improvement can vary. Besides, a quality can be characterized by different criteria or metrics, where visual quality metrics can be of value. For the case study of discrete cosine transform (DCT)based filtering, we show that improvement of radar image quality due to denoising can be predicted in a simple and fast way, especially if one deals with particular type of radar data such as images acquired by Sentinel-1. Our approach is based on application of a trained neural network that, in general, might have a different number of inputs (features). We propose a set of features describing image and noise statistics from different viewpoints. From this set, that contains 28 features, we analyze different subsets and show that a subset of the 13 most important and informative features leads to a very accurate prediction. Test image generation and network training peculiarities are discussed. The trained neural network is then tested using different verification strategies. The results of the network application to test and real-life radar images are presented, demonstrating good performance for a wide set of quality metrics.

[1]  Florence Tupin,et al.  MuLoG, or How to Apply Gaussian Denoisers to Multi-Channel SAR Speckle Reduction? , 2017, IEEE Transactions on Image Processing.

[2]  S. Quegan,et al.  Understanding Synthetic Aperture Radar Images , 1998 .

[3]  Jean-Michel Morel,et al.  Nonparametric Multiscale Blind Estimation of Intensity-Frequency-Dependent Noise , 2015, IEEE Transactions on Image Processing.

[4]  Luisa Verdoliva,et al.  A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Nikolay N. Ponomarenko,et al.  Analysis of HVS-Metrics' Properties Using Color Image Database TID2013 , 2015, ACIVS.

[6]  Gabriel Vasile,et al.  Intensity-driven adaptive-neighborhood technique for polarimetric and interferometric SAR parameters estimation , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Hyenkyun Woo,et al.  A New Multiplicative Denoising Variational Model Based on $m$th Root Transformation , 2012, IEEE Transactions on Image Processing.

[8]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[9]  K. Egiazarian,et al.  Enhancement of Component Images of Multispectral Data by Denoising with Reference , 2019 .

[10]  Nikolay N. Ponomarenko,et al.  Efficiency analysis of color image filtering , 2011, EURASIP J. Adv. Signal Process..

[11]  Karen O. Egiazarian,et al.  Additive spatially correlated noise suppression by robust block matching and adaptive 3D filtering (JIST-first) , 2019, Image Processing: Algorithms and Systems.

[12]  Victoriya Abramova,et al.  Blind estimation of speckle characteristics for sentinel polarimetric radar images , 2017, 2017 IEEE Microwaves, Radar and Remote Sensing Symposium (MRRS).

[13]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[14]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[15]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[16]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[17]  Vladimir Lukin,et al.  On Prediction of Image Denoising Expedience Using Neural Networks , 2018, 2018 International Scientific-Practical Conference Problems of Infocommunications. Science and Technology (PIC S&T).

[18]  Luis Gómez,et al.  Statistical Properties of an Unassisted Image Quality Index for SAR Imagery , 2019, Remote. Sens..

[19]  Nikolay N. Ponomarenko,et al.  DCT-Based Color Image Denoising: Efficiency Analysis and Prediction , 2015 .

[20]  Weisi Lin,et al.  Analysis of Distortion Distribution for Pooling in Image Quality Prediction , 2016, IEEE Transactions on Broadcasting.

[21]  Nikolay N. Ponomarenko,et al.  Three-State Locally Adaptive Texture Preserving Filter for Radar and Optical Image Processing , 2005, EURASIP J. Adv. Signal Process..

[22]  Ridha Touzi,et al.  A review of speckle filtering in the context of estimation theory , 2002, IEEE Trans. Geosci. Remote. Sens..

[23]  Vladimir V. Lukin,et al.  ON REQUIREMENTS TO ACCURACY OF NOISE VARIANCE ESTIMATION IN PREDICTION OF DCT-BASED FILTER EFFICIENCY , 2016 .

[24]  Vishal M. Patel,et al.  Generating high quality visible images from SAR images using CNNs , 2018, 2018 IEEE Radar Conference (RadarConf18).

[25]  Nataliia Kussul,et al.  The use of satellite SAR imagery to crop classification in Ukraine within JECAM project , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[26]  Claudia Künzer,et al.  Ten Years of Experience with Scientific TerraSAR-X Data Utilization , 2018, Remote. Sens..

[27]  Fabiana Calò,et al.  LAND COVER MAPPING USING SENTINEL-1 SAR DATA , 2016 .

[28]  Peyman Milanfar,et al.  Practical Bounds on Image Denoising: From Estimation to Information , 2011, IEEE Transactions on Image Processing.

[29]  Theophano Mitsa,et al.  Evaluation of contrast sensitivity functions for the formulation of quality measures incorporated in halftoning algorithms , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Vladimir V. Lukin,et al.  Prediction of Despeckling Efficiency of DCT-Based Filters Applied to SAR Images , 2015, 2015 International Conference on Distributed Computing in Sensor Systems.

[31]  Aleksey S. Rubel,et al.  A method for predicting DCT-based denoising efficiency for grayscale images corrupted by AWGN and additive spatially correlated noise , 2015, Electronic Imaging.

[32]  Florence Tupin,et al.  Patch similarity under non Gaussian noise , 2011, 2011 18th IEEE International Conference on Image Processing.

[33]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[34]  Valentyn Tolpekin,et al.  Fully Convolutional Networks for Multi-Temporal SAR Image Classification , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[35]  K. Egiazarian,et al.  Structural Similarity Index with Predictability of Image Blocks , 2018, 2018 IEEE 17th International Conference on Mathematical Methods in Electromagnetic Theory (MMET).

[36]  Alexey Roenko,et al.  Prediction of filtering efficiency for DCT-based image denoising , 2013, 2013 2nd Mediterranean Conference on Embedded Computing (MECO).

[37]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[38]  Yair Moshe,et al.  Image quality assessment based on DCT subband similarity , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[39]  Prabhishek Singh,et al.  A new SAR image despeckling using directional smoothing filter and method noise thresholding , 2018, Engineering Science and Technology, an International Journal.

[40]  Juan M. Lopez-Sanchez,et al.  Special Issue on Polarimetric SAR Techniques and Applications , 2017 .

[41]  F. Windmeijer,et al.  An R-squared measure of goodness of fit for some common nonlinear regression models , 1997 .

[42]  J. Astola,et al.  ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS , 2007 .

[43]  Alessandro Foi,et al.  Denoising of single-look SAR images based on variance stabilization and nonlocal filters , 2010, 2010 International Conference on Mathematical Methods in Electromagnetic Theory.

[44]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[45]  Przemysław Kupidura,et al.  COMPARISON OF FILTERS DEDICATED TO SPECKLE SUPPRESSION IN SAR IMAGES , 2016 .

[46]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[47]  Torbjørn Eltoft,et al.  A Stationary Wavelet-Domain Wiener Filter for Correlated Speckle , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Oleksiy B. Pogrebnyak,et al.  Wiener discrete cosine transform-based image filtering , 2012, J. Electronic Imaging.

[49]  Vladimir Lukin,et al.  Neural Network-based Prediction of Visual Quality for Noisy Images , 2019, 2019 IEEE 15th International Conference on the Experience of Designing and Application of CAD Systems (CADSM).

[50]  Vladimir V. Lukin,et al.  Blind DCT-based prediction of image denoising efficiency using neural networks , 2018, 2018 7th European Workshop on Visual Information Processing (EUVIP).

[51]  Sebastian Bosse,et al.  A Haar wavelet-based perceptual similarity index for image quality assessment , 2016, Signal Process. Image Commun..

[52]  Paul Siqueira,et al.  Time-series classification of Sentinel-1 agricultural data over North Dakota , 2018 .

[53]  Thomas L. Ainsworth,et al.  Improved Sigma Filter for Speckle Filtering of SAR Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Torbjørn Eltoft,et al.  Estimation of the Equivalent Number of Looks in Polarimetric SAR Imagery , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[55]  Oleksiy B. Pogrebnyak,et al.  Is Texture Denoising Efficiency Predictable? , 2018, Int. J. Pattern Recognit. Artif. Intell..

[56]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.