High-Precision Satellite Video Stabilization Method Based on ED-RANSAC Operator

Video image stabilization technology is a crucial foundation for applications such as video image target identification, monitoring, and tracking. Satellite video covers a wide range of areas with complex and similar types of objects on the ground and diverse video types. However, currently, there is a lack of a general high-precision satellite video stabilization method (VSM) that can be applied to different land cover types and imaging modes. This paper proposes a high-precision VSM based on the ED-RANSAC, an error elimination operator constrained by Euclidean distance. Furthermore, a set of accuracy evaluation methods to ensure the reliability of video stabilization are sorted out. This paper conducted video stabilization experiments using optical video data from the Jilin-01 satellite and airborne SAR video data. Under the precision evaluation criteria proposed in this paper, the optical satellite video achieved inter-frame stabilization accuracy of better than 0.15 pixels in different test areas. The overall stabilization accuracy was better than 0.15 pixels. Similarly, the SAR video achieved inter-frame stabilization accuracy better than 0.3 pixels, and the overall stabilization accuracy was better than 0.3 pixels. These experimental results demonstrate the reliability and effectiveness of the proposed method for multi-modal satellite video stabilization.

[1]  Baojun Zhao,et al.  A Scale-Aware Pyramid Network for Multi-Scale Object Detection in SAR Images , 2022, Remote. Sens..

[2]  Taoyang Wang,et al.  Small Target Tracking in Satellite Videos Using Background Compensation , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[3]  A. Alimi,et al.  Video stabilization with moving object detecting and tracking for aerial video surveillance , 2015, Multimedia Tools and Applications.

[4]  M. Dirk Robinson,et al.  SkySat-1: very high-resolution imagery from a small satellite , 2014, SPIE Remote Sensing.

[5]  Truong Q. Nguyen,et al.  Real-Time Affine Global Motion Estimation Using Phase Correlation and its Application for Digital Image Stabilization , 2011, IEEE Transactions on Image Processing.

[6]  Seong-Won Lee,et al.  Combined shape and feature-based video analysis and its application to non-rigid object tracking , 2011 .

[7]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[8]  L. Wells,et al.  Developments in sar and ifsar systems and technologies at sandia national laboratories , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[9]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  Guo Zhang,et al.  Large-Scale Orthorectification of GF-3 SAR Images Without Ground Control Points for China’s Land Area , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Yufeng Wang,et al.  A Comprehensive Review for Typical Applications Based Upon Unmanned Aerial Vehicle Platform , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Guo Zhang,et al.  SARPointNet: An Automated Feature Learning Framework for Spaceborne SAR Image Registration , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Taoyang Wang,et al.  AOSVSSNet: Attention-Guided Optical Satellite Video Smoke Segmentation Network , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Z. Li,et al.  Vehicle Tracking on Satellite Video Based on Historical Model , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[17]  Zhang Shu-jiang,et al.  Digital Image Stabilization Using Kalman Filtering , 2007 .