Fine-grained ship classification based on deep residual learning for high-resolution SAR images

ABSTRACT As the resolution of Synthetic Aperture Radar (SAR) images increases, the fine-grained classification of ships has become a focus of the SAR field. In this paper, a ship classification framework based on deep residual network for high-resolution SAR images is proposed. In general, networks with more layers have higher classification accuracy. However, the training accuracy degradation and the limited dataset are major problems in the training process. To build deeper networks, residual modules are constructed and batch normalization is applied to keep the activation function output. Different fine tuning strategies are used to select the best training scheme. To take advantage of the proposed framework, a dataset including 835 ship slices is augmented by different multiples and then used to validate our method and other Convolutional Neural Network (CNN) models. The experimental results show that, the proposed framework can achieve a 99% overall accuracy on the augmented dataset under the optimal fine-tuning strategy, 3% higher than that in other models, which demonstrates the effectiveness of our proposed approach.

[1]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Huanxin Zou,et al.  2D comb feature for analysis of ship classification in high-resolution SAR imagery , 2017 .

[5]  Haitao Lang,et al.  Ship Classification in Moderate-Resolution SAR Image by Naive Geometric Features-Combined Multiple Kernel Learning , 2017, IEEE Geoscience and Remote Sensing Letters.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Domenico Velotto,et al.  Target classification in oceanographic SAR images with deep neural networks: Architecture and initial results , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[8]  Peter F. McGuire,et al.  Automatic Target Recognition in Synthetic Aperture Radar Imagery: A State-of-the-Art Review , 2016, IEEE Access.

[9]  Hong Zhang,et al.  Ship Classification in High-Resolution SAR Images Using Deep Learning of Small Datasets , 2018, Sensors.

[10]  Mingzhe Jiang,et al.  Ship Classification Based on Superstructure Scattering Features in SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[11]  Vassilis Tsagaris,et al.  VESSEL CLASSIFICATION IN COSMO-SKYMED SAR DATA USING HIERARCHICAL FEATURE SELECTION , 2015 .

[12]  Huanxin Zou,et al.  Ship Classification in TerraSAR-X Images With Feature Space Based Sparse Representation , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  Hong Zhang,et al.  Merchant Vessel Classification Based on Scattering Component Analysis for COSMO-SkyMed SAR Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[14]  Anil K Bhat,et al.  A Prospective Study of Acute Undisplaced and Minimally Displaced Scaphoid Fractures Managed by Aggressive Conservative Approach. , 2018, The journal of hand surgery Asian-Pacific volume.

[15]  Steven D. Blostein,et al.  Classification of ships in airborne SAR imagery using backpropagation neural networks , 1997, Optics & Photonics.

[16]  Weihai Li,et al.  Ship Classification in High-Resolution SAR Images via Transfer Learning with Small Training Dataset , 2018, Sensors.

[17]  Christian Cochin,et al.  Classification of ships using real and simulated data in a convolutional neural network , 2016, 2016 IEEE Radar Conference (RadarConf).

[18]  Gerard Margarit,et al.  Ship Classification in Single-Pol SAR Images Based on Fuzzy Logic , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[19]  R. Keith Raney,et al.  On the use of permanent symmetric scatterers for ship characterization , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  Quentin Oliveau,et al.  Learning Attribute Representations for Remote Sensing Ship Category Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[23]  Qian Song,et al.  Intelligent Ship Recongnition from Synthetic Aperture Radar Images , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Kuntal Kumar Pal,et al.  Preprocessing for image classification by convolutional neural networks , 2016, 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[25]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[26]  Jianwei Li,et al.  Ship classification for unbalanced SAR dataset based on convolutional neural network , 2018, Journal of Applied Remote Sensing.

[27]  Borge Torvik,et al.  Characteristics of ships in harbour investigated in simultaneous images from TerraSAR-X and PicoSAR , 2010, 2010 IEEE Radar Conference.

[28]  Huanxin Zou,et al.  Ship Classification with High Resolution TerraSAR-X Imagery Based on Analytic Hierarchy Process , 2013 .

[29]  Bo Zhang,et al.  A Novel Hierarchical Ship Classifier for COSMO-SkyMed SAR Data , 2014, IEEE Geoscience and Remote Sensing Letters.

[30]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[31]  Yohei Sugimoto,et al.  Ship Classification from SAR Images Based on Deep Learning , 2018, IntelliSys.