Ship detection in spaceborne infrared images based on Convolutional Neural Networks and synthetic targets

Abstract Automatic detection of ships in spaceborne infrared images is important for both military and civil applications due to its all-weather detection capability. While deep learning methods have made great success in many image processing fields recently, training deep learning models still relies on large amount of labeled data, which may limit its application performance for infrared images target detection tasks. Considering that, we propose a new infrared ship detection method based on Convolutional Neural Networks (CNN) which is trained only with synthetic targets. For the problem of limited infrared training data, we design a Transfer Network (T-Net) to generate large amount of synthetic infrared-style ship targets from Google Earth images. The experiments are conducted on a near infrared band image ( 0.845 – 0.885 μ m ), a short wavelength infrared band image ( 1.560 – 1.66 μ m ) and a long wavelength infrared band image ( 2.1 – 2.3 μ m ) of Landsat-8 satellite. The results demonstrate the effectiveness of the target generation ability of T-Net. With only synthetic training samples, our detection method achieves a higher accuracy than other classical ship detection methods.

[1]  Jie Ma,et al.  Unsupervised Ship Detection Based on Saliency and S-HOG Descriptor From Optical Satellite Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[2]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Ying Yu,et al.  An approach for visual attention based on biquaternion and its application for ship detection in multispectral imagery , 2012, Neurocomputing.

[4]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Lining Gao,et al.  A Visual Search Inspired Computational Model for Ship Detection in Optical Satellite Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Bo Li,et al.  Ship Detection in High-Resolution Optical Imagery Based on Anomaly Detector and Local Shape Feature , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Ali Khenchaf,et al.  Multiscale algorithm for ship detection in mid, high and very high resolution optical imagery , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[9]  Zhenwei Shi,et al.  Detecting ship targets in spaceborne infrared image based on modeling radiation anomalies , 2017 .

[10]  Hui Zhou,et al.  A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Zhenwei Shi,et al.  Fully Convolutional Network With Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[12]  Lihua Yue,et al.  A Novel Algorithm for Ship Detection Based on Dynamic Fusion Model of Multi-feature and Support Vector Machine , 2011, 2011 Sixth International Conference on Image and Graphics.

[13]  Baojun Zhao,et al.  Compressed-Domain Ship Detection on Spaceborne Optical Image Using Deep Neural Network and Extreme Learning Machine , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Wenxian Yu,et al.  Graph-based ship extraction scheme for optical satellite image , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Zhenwei Shi,et al.  Ship Detection in Spaceborne Optical Image With SVD Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Zhenwei Shi,et al.  Multi-resolution networks for ship detection in infrared remote sensing images , 2018, Infrared Physics & Technology.