Ship Classification in TerraSAR-X Images With Convolutional Neural Networks

Synthetic aperture radar (SAR) is an important instrument for oceanographic observations, providing detailed information of oceans’ surface and artificial floating structures. Due to advances in SAR technology and deployment of new SAR satellites, an increasing amount of data is available, and the development of efficient classification systems based on deep learning is possible. A deep neural network has improved the state of the art in classification tasks of optical images, but its use in SAR classification problems has been less exploited. In this paper, a full workflow for SAR maritime targets detection and classification on TerraSAR-X high-resolution image is presented, and convolutional neural networks (CNNs) recently proposed in the literature are cross evaluated on a common data set composed of five maritime classes, namely, cargo, tanker, windmill, platform, and harbor structure. Based on experiments and tests, a multiple input resolution CNN model is proposed and its performance is evaluated. Our results indicate that CNNs are efficient models to perform maritime target classification in SAR images, and the combination of different input resolutions in the CNN model improves its ability to derive features, increasing the overall classification score.

[1]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[2]  Armando Marino,et al.  A Notch Filter for Ship Detection With Polarimetric SAR Data , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Xiao Xiang Zhu,et al.  Compressive {Sensing} for {Super}-resolving {SAR} {Imaging} to {Support} {Target} {Detection} in {Coastal} {Zone} , 2014 .

[4]  M. Migliaccio,et al.  Reflection Symmetry for Polarimetric Observation of Man-Made Metallic Targets at Sea , 2012, IEEE Journal of Oceanic Engineering.

[5]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[6]  Yong Dou,et al.  Urban Land Use and Land Cover Classification Using Remotely Sensed SAR Data through Deep Belief Networks , 2015, J. Sensors.

[7]  P. Atkinson,et al.  Introduction Neural networks in remote sensing , 1997 .

[8]  Stefan Voigt,et al.  Satellite Image Analysis for Disaster and Crisis-Management Support , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[12]  Genshe Chen,et al.  Experimental feature-based SAR ATR performance evaluation under different operational conditions , 2008, SPIE Defense + Commercial Sensing.

[13]  Domenico Velotto,et al.  Target classification in oceanographic SAR images with deep neural networks: Architecture and initial results , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[14]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[15]  Joachim H. G. Ender,et al.  On compressive sensing applied to radar , 2010, Signal Process..

[16]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[17]  Susanne Lehner,et al.  Iceberg Detection over Northern Latitudes Using High Resolution TerraSAR-X Images , 2015 .

[18]  Irena Hajnsek,et al.  Ship Detection with Spectral Analysis of Synthetic Aperture Radar: A Comparison of New and Well-Known Algorithms , 2015, Remote. Sens..

[19]  Christopher R. Jackson,et al.  Synthetic aperture radar : marine user's manual , 2004 .

[20]  Björn Tings,et al.  Ship-Iceberg Discrimination with Convolutional Neural Networks in High Resolution SAR Images , 2016 .

[21]  Domenico Velotto,et al.  Near real time monitoring of platform sourced pollution using TerraSAR-X over the North Sea. , 2014, Marine pollution bulletin.

[22]  Chris Kreucher,et al.  Modern approaches in deep learning for SAR ATR , 2016, SPIE Defense + Security.

[23]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[24]  Maurizio Migliaccio,et al.  Oil-slick observation using single look complex TerraSAR-X dual-polarized data , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[25]  Georg Heygster,et al.  An automatic detection system for natural oil seep origin estimation in SAR images , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[26]  Camilla Brekke,et al.  Statistical models for constant false alarm rate ship detection with the sublook correlation magnitude , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[28]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[29]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.

[30]  David Morgan,et al.  Deep convolutional neural networks for ATR from SAR imagery , 2015, Defense + Security Symposium.

[31]  John S. Bridle,et al.  Training Stochastic Model Recognition Algorithms as Networks can Lead to Maximum Mutual Information Estimation of Parameters , 1989, NIPS.

[32]  Michele Vespe,et al.  Vessel Pattern Knowledge Discovery from AIS Data: A Framework for Anomaly Detection and Route Prediction , 2013, Entropy.

[33]  D. Crisp,et al.  The State-of-the-Art in Ship Detection in Synthetic Aperture Radar Imagery , 2004 .

[34]  Bo Zhang,et al.  Classification of Vessels in Single-Pol COSMO-SkyMed Images Based on Statistical and Structural Features , 2015, Remote. Sens..

[35]  Vassilis Tsagaris,et al.  VESSEL CLASSIFICATION IN COSMO-SKYMED SAR DATA USING HIERARCHICAL FEATURE SELECTION , 2015 .

[36]  Gangyao Kuang,et al.  An Adaptive and Fast CFAR Algorithm Based on Automatic Censoring for Target Detection in High-Resolution SAR Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Van Wimersma Greidanus Herman,et al.  Ship classification in high and very high resolution satellite SAR imagery , 2016 .

[38]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Susanne Lehner,et al.  Dynamically adapted ship parameter estimation using TerraSAR-X images , 2016 .

[40]  Thomas Fritz,et al.  Ship Surveillance With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[42]  Maurizio Migliaccio,et al.  Dual-Polarized TerraSAR-X Data for Oil-Spill Observation , 2011, IEEE Transactions on Geoscience and Remote Sensing.