Segmentation of Oil Spills on Side-Looking Airborne Radar Imagery with Autoencoders

In this work, we use deep neural autoencoders to segment oil spills from Side-Looking Airborne Radar (SLAR) imagery. Synthetic Aperture Radar (SAR) has been much exploited for ocean surface monitoring, especially for oil pollution detection, but few approaches in the literature use SLAR. Our sensor consists of two SAR antennas mounted on an aircraft, enabling a quicker response than satellite sensors for emergency services when an oil spill occurs. Experiments on TERMA radar were carried out to detect oil spills on Spanish coasts using deep selectional autoencoders and RED-nets (very deep Residual Encoder-Decoder Networks). Different configurations of these networks were evaluated and the best topology significantly outperformed previous approaches, correctly detecting 100% of the spills and obtaining an F1 score of 93.01% at the pixel level. The proposed autoencoders perform accurately in SLAR imagery that has artifacts and noise caused by the aircraft maneuvers, in different weather conditions and with the presence of look-alikes due to natural phenomena such as shoals of fish and seaweed.

[1]  Chuanmin Hu,et al.  Tracking the Deepwater Horizon Oil Spill: A Modeling Perspective , 2011 .

[2]  Pablo Gil,et al.  An approach for SLAR images denoising based on removing regions with low visual quality for oil spill detection , 2016, Remote Sensing.

[3]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[4]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Geoffrey E. Hinton,et al.  Autoencoders, Minimum Description Length and Helmholtz Free Energy , 1993, NIPS.

[7]  Huanxin Zou,et al.  Synthetic Aperture Radar Target Recognition with Feature Fusion Based on a Stacked Autoencoder , 2017, Sensors.

[8]  Torbjørn Eltoft,et al.  Characterization of Marine Surface Slicks by Radarsat-2 Multipolarization Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Tom Ziemke,et al.  Radar image segmentation using recurrent artificial neural networks , 1996, Pattern Recognit. Lett..

[10]  Antonio-Javier Gallego,et al.  Oil Slicks Detection in SLAR Images with Autoencoders , 2017 .

[11]  Wenzhong Shi,et al.  Remote Sensing Image Classification Based on Stacked Denoising Autoencoder , 2017, Remote. Sens..

[12]  Carl E. Brown,et al.  A Review of Oil Spill Remote Sensing , 2017, Sensors.

[13]  Pablo Gil,et al.  Oil Spill Detection in Terma-Side-Looking Airborne Radar Images Using Image Features and Region Segmentation , 2018, Sensors.

[14]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[15]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[16]  Wei Wang,et al.  Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[17]  Cathleen E. Jones,et al.  State of the art satellite and airborne marine oil spill remote sensing: Application to the BP Deepwater Horizon oil spill , 2012 .

[18]  Pablo Gil,et al.  Candidate Oil Spill Detection in SLAR Data - A Recurrent Neural Network-based Approach , 2017, ICPRAM.

[19]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[22]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[23]  VincentPascal,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010 .

[24]  Guangmin Sun,et al.  Application of Deep Networks to Oil Spill Detection Using Polarimetric Synthetic Aperture Radar Images , 2017 .

[25]  Suman Singha,et al.  Satellite Oil Spill Detection Using Artificial Neural Networks , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Scott Hensley,et al.  Studies of the Deepwater Horizon Oil Spill With the UAVSAR Radar , 2013 .

[27]  Linlin Xu,et al.  A comparative study of different classification techniques for marine oil spill identification using RADARSAT-1 imagery , 2014 .

[28]  Zyad Shaaban,et al.  Data Mining: A Preprocessing Engine , 2006 .

[29]  P. Pavlakis,et al.  Dark formation detection using neural networks , 2008 .

[30]  Fabio Del Frate,et al.  Neural networks for oil spill detection using ERS-SAR data , 2000, IEEE Trans. Geosci. Remote. Sens..

[31]  Konstantinos Topouzelis,et al.  Oil spill feature selection and classification using decision tree forest on SAR image data , 2012 .

[32]  Yu Li,et al.  Comparison of Oil Spill Classifications Using Fully and Compact Polarimetric SAR Images , 2017 .

[33]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[34]  K. Topouzelis,et al.  Detection and discrimination between oil spills and look-alike phenomena through neural networks , 2007 .

[35]  Jorge Calvo-Zaragoza,et al.  Staff-line removal with selectional auto-encoders , 2017, Expert Syst. Appl..

[36]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[37]  Chuanjiang He,et al.  A Backscattering-Suppression-Based Variational Level-Set Method for Segmentation of SAR Oil Slick Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[39]  C. Schultz Monitoring and Modeling the Deepwater Horizon Oil Spill: A Record‐Breaking Enterprise , 2013 .

[40]  Domenico Velotto,et al.  A Combination of Traditional and Polarimetric Features for Oil Spill Detection Using TerraSAR-X , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Jubai An,et al.  Discrimination of Oil Slicks and Lookalikes in Polarimetric SAR Images Using CNN , 2017, Sensors.

[42]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[43]  Pascal Vincent,et al.  Generalized Denoising Auto-Encoders as Generative Models , 2013, NIPS.

[44]  Pablo Gil,et al.  Oil Spill Detection using Segmentation based Approaches , 2017, ICPRAM.

[45]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[47]  Camilla Brekke,et al.  Classifiers and Confidence Estimation for Oil Spill Detection in ENVISAT ASAR Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[48]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[49]  Amparo Alonso-Betanzos,et al.  On the use of feature selection to improve the detection of sea oil spills in SAR images , 2017, Comput. Geosci..

[50]  Arnt-Børre Salberg,et al.  Oil Spill Detection in Hybrid-Polarimetric SAR Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Shuanghui Zhang,et al.  Radar HRRP Target Recognition Based on Stacked Autoencoder and Extreme Learning Machine , 2018, Sensors.

[52]  Alireza Taravat,et al.  Adaptive Weibull Multiplicative Model and Multilayer Perceptron Neural Networks for Dark-Spot Detection from SAR Imagery , 2014, Sensors.

[53]  M. Mosavi,et al.  Optimum Features Selection for oil Spill Detection in SAR Image , 2016, Journal of the Indian Society of Remote Sensing.

[54]  Fabio Del Frate,et al.  Development of band ratioing algorithms and neural networks to detection of oil spills using Landsat ETM+ data , 2012, EURASIP J. Adv. Signal Process..

[55]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..