Optical Remote Sensing Ship Image Classification Based on Deep Feature Combined Distance Metric Learning

ABSTRACT Zhao, S.; Xu, Y.; Li, W., and Lang, H., 2020. Optical remote sensing ship image classification based on deep feature combined distance metric learning. In: Jung, H.-S.; Lee, S.; Ryu, J.-H., and Cui, T. (eds.), Advances in Geospatial Research of Coastal Environments. Journal of Coastal Research, Special Issue No. 102, pp. 82-87. Coconut Creek (Florida), ISSN 0749-0208. Image classification of ships has become an active research topic in the field of remote sensing. Effectively distinguishing specific category of a ship is crucial for many maritime matters. At present, there are two major difficulties in ship classification tasks. Firstly, the construction of traditional artificial features not only requires the assistance of professional knowledge, but also fails to represent the rich semantic information of ship images. Secondly, the classification of ships requires the identification of subcategory, the problem of intra-class diversity and inter-class similarity has become more serious and requires more careful handling. In order to solve the above problems, this paper proposes a method combining the deep feature and the distance metric learning (DML) algorithm to implement the classification of ships in the optical remote sensing images. In this study, an improved fine-tuned AlexNet convolution neural network (CNN) is adopted to extract the deep feature of ship images. The DML algorithm is applied to learn a good distance metric to reveal the similarity and dissimilarity between ships which are represented by deep feature. Comprehensive experiments show that the classification performance of deep feature combined DML algorithm significantly outperforms the comparative methods.

[1]  Xi Zhang,et al.  Ship Classification in SAR Image by Joint Feature and Classifier Selection , 2016, IEEE Geoscience and Remote Sensing Letters.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Fan Zhang,et al.  Multiple features learning for ship classification in optical imagery , 2018, Multimedia Tools and Applications.

[4]  N. Altman.  An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[5]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[7]  Wei Liu,et al.  Learning Distance Metrics with Contextual Constraints for Image Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Kai Feng,et al.  Optimized Laplacian SVM With Distance Metric Learning for Hyperspectral Image Classification , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Marc Sebban,et al.  A Survey on Metric Learning for Feature Vectors and Structured Data , 2013, ArXiv.

[10]  Qian Du,et al.  Remote Sensing Image Scene Classification Using Multi-Scale Completed Local Binary Patterns and Fisher Vectors , 2016, Remote. Sens..

[11]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  David Zhang,et al.  A Kernel Classification Framework for Metric Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Bo Li,et al.  Ship Detection in High-Resolution Optical Imagery Based on Anomaly Detector and Local Shape Feature , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.