Ship classification for unbalanced SAR dataset based on convolutional neural network

Abstract. Ship classification in synthetic aperture radar (SAR) images is essential in remote sensing but still full of challenges in the deep learning era. The unbalanced dataset and lack of models are two limitations. Upsampling with data augmentation and ratio batching are proposed to solve the first problem. Upsampling with data augmentation is upsampling by cropping and flipping. It can improve the diversity of the dataset. Ratio batching is realized by choosing the same amount of ships per class in each minibatch. It can make the model converge faster and better. To solve the second problem, a new loss function and convolutional neural network model are proposed. The new loss function can maximize the intraclass compactness and interclass separation simultaneously. Dense residual network has two submodules. One is the identity mapping through elementwise summation to reuse old features. The other is dense connection through concatenation to exploit new features. The designed architecture is suitable for the task of SAR ship classification. We use the confusion matrix and accuracy averaged on classes to measure the performance. From the experiments, we can find that the proposed ideas have excellent performance especially on the rare classes.

[1]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Huanxin Zou,et al.  Ship Classification in TerraSAR-X Images With Feature Space Based Sparse Representation , 2013, IEEE Geoscience and Remote Sensing Letters.

[4]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Bo Zhang,et al.  A Novel Hierarchical Ship Classifier for COSMO-SkyMed SAR Data , 2014, IEEE Geoscience and Remote Sensing Letters.

[6]  Jun Wu,et al.  A novel ship classification approach for high resolution SAR images based on the BDA-KELM classification model , 2017 .

[7]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[8]  Domenico Velotto,et al.  Ship Classification in TerraSAR-X Images With Convolutional Neural Networks , 2018, IEEE Journal of Oceanic Engineering.

[9]  Lanqing Huang,et al.  OpenSARShip: A Dataset Dedicated to Sentinel-1 Ship Interpretation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[11]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[12]  G. J. Owirka,et al.  Automatic target recognition using enhanced resolution SAR data , 1999 .

[13]  Gerard Margarit,et al.  Ship Classification in Single-Pol SAR Images Based on Fuzzy Logic , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Yijing Li,et al.  Learning from class-imbalanced data: Review of methods and applications , 2017, Expert Syst. Appl..

[15]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Carlos López-Martínez,et al.  Exploitation of Ship Scattering in Polarimetric SAR for an Improved Classification Under High Clutter Conditions , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Antonio De Maio,et al.  Automatic Target Recognition of Military Vehicles With Krawtchouk Moments , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Carmine Clemente,et al.  Pseudo-Zernike Based Multi-Pass Automatic Target Recognition From Multi-Channel SAR , 2014, ArXiv.