Shipsrdet: An End-to-End Remote Sensing Ship Detector Using Super-Resolved Feature Representation

High-resolution remote sensing images can provide abundant appearance information for ship detection. Although several existing methods use image super-resolution (SR) approaches to improve the detection performance, they consider image SR and ship detection as two separate processes and overlook the internal coherence between these two correlated tasks. In this paper, we explore the potential benefits introduced by image SR to ship detection, and propose an end-to-end network named ShipSRDet. In our method, we not only feed the super-resolved images to the detector but also integrate the intermediate features of the SR network with those of the detection network. In this way, the informative feature representation extracted by the SR network can be fully used for ship detection. Experimental results on the HRSC dataset validate the effectiveness of our method. Our ShipSRDet can recover the missing details from the input image and achieves promising ship detection performance.

[1]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Yiping Yang,et al.  A High Resolution Optical Satellite Image Dataset for Ship Recognition and Some New Baselines , 2017, ICPRAM.

[4]  Longguang Wang,et al.  Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Adam Van Etten,et al.  The Effects of Super-Resolution on Object Detection Performance in Satellite Imagery , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Minh-Tan Pham,et al.  Small Object Detection in Remote Sensing Images Based on Super-Resolution with Auxiliary Generative Adversarial Networks , 2020, Remote. Sens..

[9]  Yulan Guo,et al.  Symmetric Parallax Attention for Stereo Image Super-Resolution , 2020, ArXiv.

[10]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[11]  Wei An,et al.  Light Field Image Super-Resolution Using Deformable Convolution , 2020, IEEE Transactions on Image Processing.

[12]  Jakaria Rabbi,et al.  Small-Object Detection in Remote Sensing Images with End-to-End Edge-Enhanced GAN and Object Detector Network , 2020, ArXiv.

[13]  Jungang Yang,et al.  Spatial-Angular Interaction for Light Field Image Super-Resolution , 2020, ECCV.

[14]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[15]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).