Inshore Ship Detection Based on Convolutional Neural Network in Optical Satellite Images

In this paper, we present a novel inshore ship detection method based on convolutional neural network (CNN). Different from current inshore ship detection methods that need complex shape and texture analysis or sea and land segmentation, our method starts from a global search for the relatively distinct ship head with an efficient classification network. This can help to obtain the location of possible ship heads as well as the rough ship directions, which are beneficial to generate smaller and more precise candidate regions of ship targets. Compared with other region proposal methods, our method can produce a rather smaller set of proposals. Next, iterative bounding-box regression and classification are unified into a multitask network, which is constructed and trained specially by considering the practical condition of the inshore ships in remote sensing images. At last, nonmaximum suppression is applied to eliminate duplicate detections. Experiments on optical satellite images demonstrate the effectiveness and robustness of the proposed method for inshore ship detection.

[1]  Heng-Ming Tai,et al.  Inshore Ship Detection in Remote Sensing Images via Weighted Pose Voting , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[5]  Jian Yang,et al.  The Extended Bragg Scattering Model-Based Method for Ship and Oil-Spill Observation Using Compact Polarimetric SAR , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[7]  Xinwei Zheng,et al.  A New Method on Inshore Ship Detection in High-Resolution Satellite Images Using Shape and Context Information , 2014, IEEE Geoscience and Remote Sensing Letters.

[8]  Gaofeng Meng,et al.  FusionNet: Edge Aware Deep Convolutional Networks for Semantic Segmentation of Remote Sensing Harbor Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[10]  Bo Zhang,et al.  Ship Detection for High-Resolution SAR Images Based on Feature Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[11]  Hui Zhou,et al.  A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jian Xu,et al.  Automatic Detection of Inshore Ships in High-Resolution Remote Sensing Images Using Robust Invariant Generalized Hough Transform , 2014, IEEE Geoscience and Remote Sensing Letters.

[13]  Jing Chen,et al.  A Decision Mixture Model-Based Method for Inshore Ship Detection Using High-Resolution Remote Sensing Images , 2017, Sensors.

[14]  Knut Eldhuset,et al.  An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions , 1996, IEEE Trans. Geosci. Remote. Sens..

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[17]  Jean-Yves Tourneret,et al.  Ship and Oil-Spill Detection Using the Degree of Polarization in Linear and Hybrid/Compact Dual-Pol SAR , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Yuan Tian,et al.  Ship detection by salient convex boundaries , 2010, 2010 3rd International Congress on Image and Signal Processing.

[19]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Sun Li,et al.  A Novel Inshore Ship Detection via Ship Head Classification and Body Boundary Determination , 2016, IEEE Geoscience and Remote Sensing Letters.

[21]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[22]  Paris W. Vachon,et al.  Optimization of the Degree of Polarization for Enhanced Ship Detection Using Polarimetric RADARSAT-2 , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Xiaobin Li,et al.  Object Detection Using Convolutional Neural Networks in a Coarse-to-Fine Manner , 2017, IEEE Geoscience and Remote Sensing Letters.

[24]  Larry S. Davis,et al.  G-CNN: An Iterative Grid Based Object Detector , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jie Ma,et al.  Unsupervised Ship Detection Based on Saliency and S-HOG Descriptor From Optical Satellite Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[26]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jian Yao,et al.  S-CNN-BASED SHIP DETECTION FROM HIGH-RESOLUTION REMOTE SENSING IMAGES , 2016 .

[28]  Liming Jiang,et al.  Using SAR Images to Detect Ships From Sea Clutter , 2008, IEEE Geoscience and Remote Sensing Letters.

[29]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Carlos López-Martínez,et al.  A novel algorithm for ship detection in SAR imagery based on the wavelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[31]  Vincent Pagé,et al.  Characterization of a Bayesian Ship Detection Method in Optical Satellite Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[32]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[33]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[36]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[37]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[38]  Zongxu Pan,et al.  Ship Detection in Gaofen-3 SAR Images Based on Sea Clutter Distribution Analysis and Deep Convolutional Neural Network , 2018, Sensors.

[39]  Guang Yang,et al.  Ship Detection From Optical Satellite Images Based on Sea Surface Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.