Contour Refinement and EG-GHT-Based Inshore Ship Detection in Optical Remote Sensing Image

Inshore ship detection becomes challenging in high-resolution optical remote sensing image (RSI) because inshore ships are often incomplete and deformed due to the poor imaging condition and shadow of ship superstructure, and there are various interferences in harbor. A contour refinement and the improved generalized Hough transform (GHT)-based inshore ship detection scheme is proposed for RSI with complex harbor scenes. First, the suspected region of ships (SRS) is located in the entire RSI according to the line segments of ship body and docks. The contours in each SRS are then refined to repair the damaged ship head contour (SHC) using the convex set characteristics of ship head and subsequently reduce non-SHC by curvature filtering. In each refined SRS, equal frequency quantification instead of equal width quantification for R-Table construction and Gini coefficient-based decision criterion combining the number and distribution of votes are proposed to improve GHT (i.e., EG-GHT) and to extract SHCs as candidate targets. The false candidates are removed according to pixel proportion described by the structured binarization feature. Applying the border scoring strategy, the best candidates with the largest score among all the overlapped bounding boxes are selected as the final detection targets. Using the public RSIs with various cases, including turbid water, cloud occlusion, ships moored together, and ships with the different sizes, experimental results demonstrate the proposed scheme outperforms state-of-the-art contour-based methods and deep learning-based methods in terms of precision–recall rate and average precision, respectively.

[1]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Sun Li,et al.  A Novel Inshore Ship Detection via Ship Head Classification and Body Boundary Determination , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Jian Xu,et al.  Automatic Detection of Inshore Ships in High-Resolution Remote Sensing Images Using Robust Invariant Generalized Hough Transform , 2014, IEEE Geoscience and Remote Sensing Letters.

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  Su Yi,et al.  An Inshore Ship Detection Method Based on Contour Matching , 2010 .

[6]  Menglong Yan,et al.  Integrated Localization and Recognition for Inshore Ships in Large Scene Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[8]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Hua Yang,et al.  Polygon-Invariant Generalized Hough Transform for High-Speed Vision-Based Positioning , 2016, IEEE Transactions on Automation Science and Engineering.

[10]  N. Kanopoulos,et al.  Design of an image edge detection filter using the Sobel operator , 1988, IEEE J. Solid State Circuits.

[11]  Xiao Xiang Zhu,et al.  Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Deren Li,et al.  Object Classification of Aerial Images With Bag-of-Visual Words , 2010, IEEE Geoscience and Remote Sensing Letters.

[13]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..

[14]  Knut Eldhuset,et al.  An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions , 1996, IEEE Trans. Geosci. Remote. Sens..

[15]  Heng-Ming Tai,et al.  Inshore Ship Detection in Remote Sensing Images via Weighted Pose Voting , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Xian Sun,et al.  Object Detection in High-Resolution Remote Sensing Images Using Rotation Invariant Parts Based Model , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Jiang Li An AIAC-based Inshore Ship Target Detection Approach , 2007 .

[18]  Fan Chen,et al.  Rotation-Invariant Object Detection in Remote Sensing Images Based on Radial-Gradient Angle , 2015, IEEE Geoscience and Remote Sensing Letters.

[19]  Lei Zhang,et al.  Canny edge detection enhancement by scale multiplication , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[21]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Xinwei Zheng,et al.  A New Method on Inshore Ship Detection in High-Resolution Satellite Images Using Shape and Context Information , 2014, IEEE Geoscience and Remote Sensing Letters.

[24]  Xiao Xiang Zhu,et al.  HSF-Net: Multiscale Deep Feature Embedding for Ship Detection in Optical Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Hui Zhou,et al.  A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Shuangjiu Xiao,et al.  A Line Segment Based Inshore Ship Detection Method , 2012 .

[27]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[28]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[29]  Zhang Zhen Detection of Ships in Harbor in Remote Sensing Image Based on Local Self-similarity , 2009 .

[30]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Xiaobin Li,et al.  Object Detection Using Convolutional Neural Networks in a Coarse-to-Fine Manner , 2017, IEEE Geoscience and Remote Sensing Letters.

[32]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .

[33]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.