Method for the Automatic Generation and Application of Landmark Control Point Library

Ground control points play an important role in improving the positioning accuracy of satellite images. At present, most control points must be obtained by manual deployment (calibration field) or feature extraction. The control points obtained by manual deployment are fixed in certain areas and have a high deployment cost. The current method for feature matching is limited by the acquisition of the reference image and matching accuracy, which results in poor flexibility and is not conducive to improvements to worldwide satellite positioning precision. To solve this problem, this study proposes a new automatic generation and application algorithm for landmark control points across the globe based on the deep learning method. Using this method, landmarks can be selected and the deep-learning-based target-detection method can be used to realize the automatic generation of control points. When satellite images with relatively low positioning precision are used, landmark control points can be accurately obtained with a precision reaching the sub-pixel level, which can provide a sufficient foundation for the geometric correction of non-mapping satellite images. In this study, a remote sensing image dataset of road intersections was also constructed, which considers road intersections as landmarks. The experiment is carried out with the road intersection dataset, and CenterNet network is trained. The experiments show that the detection precision of the network can reach 96.27%. Finally, we designed an application strategy for the landmark control points and improved the image matching method, such that the matching precision between the landmark images and images to be processed can reach the sub-pixel level and conform to the requirements of geometric correction for non-mapping satellite images.

[1]  J. Grodecki,et al.  IKONOS GEOMETRIC ACCURACY VALIDATION , 2002 .

[2]  P. Radhadevi,et al.  In‐flight geometric calibration of different cameras of IRS‐P6 using a physical sensor model , 2008 .

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Taoyang Wang,et al.  Geometric Accuracy Validation for ZY-3 Satellite Imagery , 2014, IEEE Geoscience and Remote Sensing Letters.

[5]  Yongjun Zhang,et al.  An Image Matching Algorithm Integrating Global SRTM and Image Segmentation for Multi-Source Satellite Imagery , 2016, Remote. Sens..

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Xiaoyun Hao,et al.  Integrating Stereo Images and Laser Altimeter Data of the ZY3-02 Satellite for Improved Earth Topographic Modeling , 2019, Remote. Sens..

[8]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[9]  Bo Yang,et al.  On-Orbit Geometric Calibration Model and Its Applications for High-Resolution Optical Satellite Imagery , 2014, Remote. Sens..

[10]  Yansong Duan,et al.  Adaptive Re-weighted Block Adjustment for Multi-Coverage Satellite Stereo Images without Ground Control Points , 2019, IEEE Access.

[11]  Yi Lei,et al.  A spatial multi-scale integer coding method and its application to three-dimensional model organization , 2020, Int. J. Digit. Earth.

[12]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Wang Mi On-orbit Geometric Calibration and Accuracy Assessment of ZY-3 , 2012 .

[14]  Takeo Tadono,et al.  PRISM On-Orbit Geometric Calibration and DSM Performance , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Yang Li,et al.  Rapid Relocation Method for Mobile Robot Based on Improved ORB-SLAM2 Algorithm , 2019, Remote. Sens..

[16]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Peter Sturm,et al.  Estimation of an Observation Satellite’s Attitude Using Multimodal Pushbroom Cameras , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[20]  Gang Wan,et al.  Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[21]  Xiaohua Tong,et al.  Detection and Estimation of Along-Track Attitude Jitter From Ziyuan-3 Three-Line-Array Images Based on Back-Projection Residuals , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Mattia Crespi,et al.  GeoEye-1: Analysis of Radiometric and Geometric Capability , 2010, PSATS.

[23]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[24]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[25]  Li He,et al.  Global multi-scale grid integer coding and spatial indexing: A novel approach for big earth observation data , 2020 .

[26]  Lei Yang,et al.  Star Detection and Accurate Centroiding for the Geosynchronous Interferometric Infrared Sounder of Fengyun-4A , 2019, IEEE Access.

[27]  Jingyin Wang,et al.  CCD distortion calibration without accurate ground control data for pushbroom satellites , 2018 .

[28]  Toon Goedemé,et al.  Vehicle and Vessel Detection on Satellite Imagery: A Comparative Study on Single-Shot Detectors , 2020, Remote. Sens..

[29]  Yi-Ping Hung,et al.  RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Serge J. Belongie,et al.  Residual Networks Behave Like Ensembles of Relatively Shallow Networks , 2016, NIPS.

[31]  A. Gruen,et al.  Orientation and self‐calibration of ALOS PRISM imagery , 2008 .

[32]  Taoyang Wang,et al.  Comparison between Plane and Stereo Block Adjustment For ZY-3 Satellite Images , 2019 .

[33]  Yi Su,et al.  Accurate Star Centroid Detection for the Advanced Geosynchronous Radiation Imager of Fengyun-4A , 2018, IEEE Access.

[34]  Xinming Tang,et al.  Geometric Calibration and Accuracy Assessment of ZiYuan-3 Multispectral Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Taejung Kim,et al.  Automatic precision correction of satellite images using the GCP chips of lower resolution , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[36]  Niu Chun-ying A Preliminary Study on Automatic Selection of GCP Based on Image Database , 2008 .

[37]  Ding Lu,et al.  Research on Automatic Generation and Data Organization Method of Control Points , 2018, 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[38]  Junkai Wang,et al.  Enhanced Delaunay Triangulation Sea Ice Tracking Algorithm with Combining Feature Tracking and Pattern Matching , 2020, Remote. Sens..

[39]  Masanobu Shimada,et al.  Calibration of PRISM and AVNIR-2 Onboard ALOS “Daichi” , 2009, IEEE Transactions on Geoscience and Remote Sensing.