Extracting Compact Information from Image Benchmarking Tools: The SAR Despeckling Case

Image databases and benchmarks are precious tools to assess the quality of competing algorithms and to fine tune their parameters. In some cases, however, quality cannot be captured by a single measure, and several of them, providing typically contrasting indications, must be computed and analyzed. This is certainly the case for the SAR despeckling field, also because of the lack of clean reference images, which forces one to compute the measures of interest on simple canonical scenes. We present here the first results of an ongoing work aimed at selecting a suitable combination of benchmark measures to assess competing SAR despeckling techniques and rank them. The full validation of the proposed methodology will require the involvement of a reasonable number of expert photo-interpreters for a large-scale experimental campaign. Here, we present only a sample experiment to provide some insight about the approach.

[1]  Markus Rupp,et al.  Reproducible research in signal processing , 2009, IEEE Signal Processing Magazine.

[2]  Luisa Verdoliva,et al.  Benchmarking Framework for SAR Despeckling , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Thed N. van Leeuwen,et al.  The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence , 2003, Scientometrics.

[4]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  G. Scarpa,et al.  Remote sensing segmentation benchmark , 2012, 7th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[6]  Davide Cozzolino,et al.  Fast Adaptive Nonlocal SAR Despeckling , 2014, IEEE Geoscience and Remote Sensing Letters.

[7]  Luisa Verdoliva,et al.  A nonlocal approach for SAR image denoising , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Luisa Verdoliva,et al.  A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Giorgio Franceschetti,et al.  SARAS: a synthetic aperture radar (SAR) raw signal simulator , 1992, IEEE Trans. Geosci. Remote. Sens..

[11]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[12]  E. Nezry,et al.  Adaptive speckle filters and scene heterogeneity , 1990 .

[13]  Giuseppe Scarpa,et al.  Unsupervised Texture Segmentation by Spectral-Spatial-Independent Clustering , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Luisa Verdoliva,et al.  Costs and Advantages of Object-Based Image Coding with Shape-Adaptive Wavelet Transform , 2007, EURASIP J. Image Video Process..

[15]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.