A framework for SAR-optical stereogrammetry over urban areas

Currently, numerous remote sensing satellites provide a huge volume of diverse earth observation data. As these data show different features regarding resolution, accuracy, coverage, and spectral imaging ability, fusion techniques are required to integrate the different properties of each sensor and produce useful information. For example, synthetic aperture radar (SAR) data can be fused with optical imagery to produce 3D information using stereogrammetric methods. The main focus of this study is to investigate the possibility of applying a stereogrammetry pipeline to very-high-resolution (VHR) SAR-optical image pairs. For this purpose, the applicability of semi-global matching is investigated in this unconventional multi-sensor setting. To support the image matching by reducing the search space and accelerating the identification of correct, reliable matches, the possibility of establishing an epipolarity constraint for VHR SAR-optical image pairs is investigated as well. In addition, it is shown that the absolute geolocation accuracy of VHR optical imagery with respect to VHR SAR imagery such as provided by TerraSAR-X can be improved by a multi-sensor block adjustment formulation based on rational polynomial coefficients. Finally, the feasibility of generating point clouds with a median accuracy of about 2 m is demonstrated and confirms the potential of 3D reconstruction from SAR-optical image pairs over urban areas.

[1]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[2]  M. Morgan,et al.  EPIPOLAR GEOMETRY OF LINEAR ARRAY SCANNERS MOVING WITH CONSTANT VELOCITY AND CONSTANT ATTITUDE , 2004 .

[3]  C. Fraser,et al.  Bias-compensated RPCs for sensor orientation of high-resolution satellite imagery , 2005 .

[4]  Peter Steigenberger,et al.  Imaging Geodesy—Toward Centimeter-Level Ranging Accuracy With TerraSAR-X , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Peter Reinartz,et al.  DSM BASED ORIENTATION OF LARGE STEREO SATELLITE IMAGE BLOCKS , 2012 .

[6]  T. Toutin.  Comparison of 3D Physical and Empirical Models for Generating DSMs from Stereo HR Images , 2006 .

[7]  C. Tao,et al.  A Comprehensive Study of the Rational Function Model for Photogrammetric Processing , 2001 .

[8]  A. S. Leonov,et al.  Methods for Solving Ill-Posed Extremum Problems with Optimal and Extra-Optimal Properties , 2019, Mathematical Notes.

[9]  C. Tao,et al.  3D Reconstruction methods based on the rational function model , 2002 .

[10]  T. Schenk,et al.  Resampling digital imagery to epipolar geometry , 1992 .

[11]  Xiao Xiang Zhu,et al.  EXPLORING THE APPLICABILITY OF SEMI-GLOBAL MATCHING FOR SAR-OPTICAL STEREOGRAMMETRY OF URBAN SCENES , 2018 .

[12]  John C. Curlander,et al.  Location of Spaceborne Sar Imagery , 1982, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Taejung Kim,et al.  A Study on the Epipolarity of Linear Pushbroom Images , 2000 .

[14]  Hammam A. Alshazly,et al.  Image Features Detection, Description and Matching , 2016 .

[15]  J. Grodecki,et al.  Block Adjustment of High-Resolution Satellite Images Described by Rational Polynomials , 2003 .

[16]  Uwe Soergel,et al.  Combining High-Resolution Optical and InSAR Features for Height Estimation of Buildings With Flat Roofs , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[18]  Mathias Schardt,et al.  Using worldwide available TerraSAR-X data to calibrate the geo-location accuracy of optical sensors , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Mathias Schardt,et al.  The Epipolarity Constraint in Stereo-Radargrammetric DEM Generation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Xiao Xiang Zhu,et al.  Towards automatic SAR-optical stereogrammetry over urban areas using very high resolution imagery , 2018, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[21]  Charles K. Toth,et al.  A Piecewise Approach to Epipolar Resampling of Pushbroom Satellite Images Based on RPC , 2010 .

[22]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[23]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  X. Tong,et al.  Bias-corrected rational polynomial coefficients for high accuracy geo-positioning of QuickBird stereo imagery , 2010 .

[25]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  A. B. Orun,et al.  A modified bundle adjustment software for SPOT imagery and photography: tradeoff , 1994 .

[27]  C. Tao,et al.  Use of the Rational Function Model for Image Rectification , 2001 .

[28]  Lloyd H. Hughes,et al.  INVESTIGATION OF JOINT VISIBILITY BETWEEN SAR AND OPTICAL IMAGES OF URBAN ENVIRONMENTS , 2018 .

[29]  Raquel Urtasun,et al.  Exploiting Deep Matching and SAR Data for the Geo-Localization Accuracy Improvement of Optical Satellite Images , 2017, Remote. Sens..

[30]  W. Brown.  Synthetic Aperture Radar , 1967, IEEE Transactions on Aerospace and Electronic Systems.

[31]  Geoffrey Egnal,et al.  Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  C. Vincent Tao,et al.  Photogrammetric exploitation of IKONOS imagery for mapping applications , 2004 .

[33]  V. Kratky,et al.  Rigorous photogrammetric processing of SPOT images at CCM Canada , 1989 .

[34]  Matthias Butenuth,et al.  A Performance Study on Different Stereo Matching Costs Using Airborne Image Sequences and Satellite Images , 2011, PIA.

[35]  Peter Reinartz,et al.  Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Xiao Xiang Zhu,et al.  Data Fusion and Remote Sensing: An ever-growing relationship , 2016, IEEE Geoscience and Remote Sensing Magazine.

[37]  Kaichang Di,et al.  Integration of Ikonos and QuickBird Imagery for Geopositioning Accuracy Analysis , 2007 .

[38]  C. Fraser,et al.  Sensor orientation via RPCs , 2006 .

[39]  J. Raggam,et al.  A combination of SAR and optical line scanner imagery for stereoscopic extraction of 3-D data , 1994 .

[40]  Eric J. Fielding,et al.  A demonstration of stereophotogrammetry with combined SIR-B and Landsat TM images , 1988 .

[41]  Yunhua Zhang,et al.  A Rigorous SAR Epipolar Geometry Modeling and Application to 3D Target Reconstruction , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[43]  Timo Balz,et al.  Rational function modeling for spaceborne SAR datasets , 2011 .

[44]  Leonidas J. Guibas,et al.  Estimating surface normals in noisy point cloud data , 2004, Int. J. Comput. Geom. Appl..

[45]  Reinhard Klein,et al.  Eurographics Symposium on Point-based Graphics (2006) Octree-based Point-cloud Compression , 2022 .