Methods for the Epipolarity Analysis of Pushbroom Satellite Images Based on the Rational Function Model

Epipolarity is the foundation of epipolar resampling, which is used to eliminate the vertical disparity between stereo pairs in stereo matching. To analyze the epipolarity of pushbroom satellite images, this paper compares three methods based on the rational function model (RFM): the projection trajectory method (PTM), the piecewise projection trajectory method (PPTM) and our extended projection trajectory method (EPTM). To evaluate the quality of epipolar curves, we defined the deviation coefficient as a metric to evaluate the bending degree of epipolar curves. We also defined the maximum deviation coefficient of an image that can be used to determinate the tile size in multiview satellite image 3D reconstruction based on image dividing. Comparison experiments have been carried out with pushbroom satellite images using these three methods. Experimental results show that our EPTM is more convenient and practical. It only needs the forward form of the RFM to analyze the epipolarity and can be used in the epipolarity analysis of a single image. By projecting straight lines in the ground space into the image space, the EPTM can be used to perform comprehensive epipolarity analysis for pushbroom satellite images. In addition, the EPTM can be used to calculate the maximum deviation coefficient of an image that the PTM and the PPTM cannot calculate, which is important in 3D reconstruction using multiview satellite images.

[1]  Marc Bosch,et al.  A multiple view stereo benchmark for satellite imagery , 2016, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[2]  Andrea Fusiello,et al.  Quasi-Euclidean uncalibrated epipolar rectification , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  C. Tao,et al.  3D Reconstruction methods based on the rational function model , 2002 .

[4]  Mahamadou Idrissa,et al.  Generic epipolar resampling method for perspective frame camera and linear push-broom sensor , 2016 .

[5]  Paul F. Whelan,et al.  Projective rectification from the fundamental matrix , 2005, Image Vis. Comput..

[6]  K. Gong,et al.  DSM Generation from High Resolution Multi-View Stereo Satellite Imagery , 2019, Photogrammetric Engineering & Remote Sensing.

[7]  Chang-Hahk Hahm,et al.  Analysis of Epipolar Geometry in Linear Array Scanner Scenes , 2005 .

[8]  Hossein Arefi,et al.  Stereo rectification of pushbroom satellite images by robustly estimating the fundamental matrix , 2019, International Journal of Remote Sensing.

[9]  Hong Sun,et al.  An SRTM-Aided Epipolar Resampling Method for Multi-Source High-Resolution Satellite Stereo Observation , 2019, Remote. Sens..

[10]  Deng Xue-qing.  A Study on the Epipolarity of Linear CCD Push-broom Images , 2004 .

[11]  Mehdi Mokhtarzade,et al.  A novel approach for epipolar resampling of cross-track linear pushbroom imagery using orbital parameters model , 2018 .

[12]  Kyung-Ok Kim,et al.  Epipolar Geometry of Line Cameras Moving with Constant Velocity and Attitude , 2005 .

[13]  Dieter Fritsch,et al.  Some Stuttgart Highlights of Photogrammetry and Remote Sensing , 2015 .

[14]  C. Tao,et al.  A Comprehensive Study of the Rational Function Model for Photogrammetric Processing , 2001 .

[15]  Julien Michel,et al.  On stereo-rectification of pushbroom images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Jaehong Oh.  Novel Approach to Epipolar Resampling of HRSI and Satellite Stereo Imagery-based Georeferencing of Aerial Images , 2011 .

[17]  A. B. Orun,et al.  A modified bundle adjustment software for SPOT imagery and photography: tradeoff , 1994 .

[18]  Mohammad Saadatseresht,et al.  QUASI-EPIPOLAR RESAMPLING OF HIGH RESOLUTION SATELLITE STEREO IMAGERY FOR SEMI GLOBAL MATCHING , 2015 .

[19]  Hyun-Seung Yang,et al.  Unified piecewise epipolar resampling method for pushbroom satellite images , 2016, EURASIP J. Image Video Process..

[20]  Dan Zhaoa,et al.  EPIPOLAR LINE GENERATION FROM IKONOS IMAGERY BASED ON RATIONAL FUNCTION MODEL , 2008 .

[21]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[22]  Dong-Min Woo,et al.  Epipolar Resampling of Pushbroom Satellite Images Using Piecewise Linear Implementation of Pseudo Epipolar Line , 2018 .

[23]  Enric Meinhardt,et al.  Automatic 3D Reconstruction from Multi-date Satellite Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  Tetsu Ono,et al.  DIGITAL MAPPING USING HIGH RESOLUTION SATELLITE IMAGERY BASED ON 2D AFFINE PROJECTION MODEL , 2000 .

[25]  Charles K. Toth,et al.  A Piecewise Approach to Epipolar Resampling of Pushbroom Satellite Images Based on RPC , 2010 .

[26]  Mehdi Mokhtarzade,et al.  Epipolar Resampling of Cross-Track Pushbroom Satellite Imagery Using the Rigorous Sensor Model , 2017, Sensors.

[27]  Andrea Fusiello,et al.  Quasi-Euclidean epipolar rectification of uncalibrated images , 2010, Machine Vision and Applications.

[28]  Yong-Kyu Roh,et al.  High-Resolution Remote Sensing Satellite with Application , 1999 .

[29]  Clive S. Fraser,et al.  ORIENTATION OF HIGH-RESOLUTION SATELLITE IMAGES BASED ON AFFINE PROJECTION , 2010 .

[30]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[31]  Taejung Kim,et al.  Comparison of Computer Vision and Photogrammetric Approaches for Epipolar Resampling of Image Sequence , 2016, Sensors.

[32]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[33]  Taejung Kim,et al.  A Study on the Epipolarity of Linear Pushbroom Images , 2000 .