A combined use of multispectral and SAR images for ship detection and characterization through object based image analysis

Marine routes represent a huge portion of commercial and human trades, therefore surveillance, security and environmental protection themes are gaining increasing importance. Being able to overcome the limits imposed by terrestrial means of monitoring, ship detection from satellite has recently prompted a renewed interest for a continuous monitoring of illegal activities. This paper describes an automatic Object Based Image Analysis (OBIA) approach to detect vessels made of different materials in various sea environments. The combined use of multispectral and SAR images allows for a regular observation unrestricted by lighting and atmospheric conditions and complementarity in terms of geographic coverage and geometric detail. The method developed adopts a region growing algorithm to segment the image in homogeneous objects, which are then classified through a decision tree algorithm based on spectral and geometrical properties. Then, a spatial analysis retrieves the vessels’ position, length and heading parameters and a speed range is associated. Optimization of the image processing chain is performed by selecting image tiles through a statistical index. Vessel candidates are detected over amplitude SAR images using an adaptive threshold Constant False Alarm Rate (CFAR) algorithm prior the object based analysis. Validation is carried out by comparing the retrieved parameters with the information provided by the Automatic Identification System (AIS), when available, or with manual measurement when AIS data are not available. The estimation of length shows R2=0.85 and estimation of heading R2=0.92, computed as the average of R2 values obtained for both optical and radar images.

[1]  J. Campbell,et al.  Ocean surface feature detection with the CCRS along-track InSAR , 1997 .

[2]  M. Yeremy,et al.  Ocean Surveillance with Polarimetric SAR , 2001 .

[3]  D. Crisp,et al.  The State-of-the-Art in Ship Detection in Synthetic Aperture Radar Imagery , 2004 .

[4]  Naoki Suzuki,et al.  Benchmarking operational SAR ship detection , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[5]  G. Lemoine,et al.  Integrating remote sensing in fisheries control , 2005 .

[6]  M. Sciotti,et al.  Maritime multi-sensor data association based on geographic and navigational knowledge , 2008, 2008 IEEE Radar Conference.

[7]  Hui Zhou,et al.  A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Vincent Pagé,et al.  Characterization of a Bayesian Ship Detection Method in Optical Satellite Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[9]  Laurent Najman,et al.  A complete processing chain for ship detection using optical satellite imagery , 2010 .

[10]  Yuan Tian,et al.  Ship Detection Using Texture Statistics from Optical Satellite Images , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[11]  Thomas Fritz,et al.  Ship Surveillance With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Michael Teutsch,et al.  Detection and classification of man-made offshore objects in TerraSAR-X and RapidEye imagery: Selected results of the DeMarine-DEKO project , 2011, OCEANS 2011 IEEE - Spain.

[13]  Hans C. Graber,et al.  Imaging Ships from Satellites , 2013 .

[14]  Henri Bouma,et al.  Segmentation and wake removal of seafaring vessels in optical satellite images , 2013, Optics/Photonics in Security and Defence.

[15]  Haigang Sui,et al.  Automatic ship detection for optical satellite images based on visual attention model and LBP , 2014, 2014 IEEE Workshop on Electronics, Computer and Applications.

[16]  Guang Yang,et al.  Ship Detection From Optical Satellite Images Based on Sea Surface Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Panagiotis Partsinevelos,et al.  Ship extraction and categorization from ASTER VNIR imagery , 2014, International Conference on Remote Sensing and Geoinformation of Environment.

[18]  Nicolas Longépé,et al.  Ship detection in SAR medium resolution imagery for maritime surveillance: Algorithm validation using AIS data , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[19]  Francesco Topputo,et al.  Space shepherd: Search and rescue of illegal immigrants in the mediterranean sea through satellite imagery , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[20]  Bo Zhang,et al.  Vessel detection and analysis combining SAR images and AIS information , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[21]  Francesco Topputo,et al.  OBIA ship detection with multispectral and SAR images: A simulation for Copernicus security applications , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).