Block adjustment and coupled epipolar rectification of LROC NAC images for precision lunar topographic mapping

Abstract The narrow-angle camera (NAC) of the lunar reconnaissance orbiter camera (LROC) uses a pair of closely attached pushbroom sensors to obtain a large swath of coverage while providing high-resolution imaging. However, the two image sensors do not share the same lenses and cannot be modelled geometrically with a single physical model. The irregular image network leads to difficulties in conducting the block adjustment to remove inconsistencies between the NAC images in both intra- and inter-track cases. In addition, the special image network requires two to four stereo models, each with an irregular overlapping region of varying size. The stereo configuration of NAC images also creates severe problems for the state-of-the-art image matching methods. With the aim of using NAC stereo pairs for precision 3D topographic mapping, this paper presents a novel approach to the block adjustment and coupled epipolar rectification of NAC stereo images. This approach removes the internal inconsistencies in a single block adjustment and merges the image pair in the disparity space, thus requiring estimation of only one stereo model. Semi-global matching is used to generate a disparity map for the stereo pair; each correspondence is transformed back to the source image, and 3D points are derived via photogrammetric space intersection. The experimental results reveal that the proposed approach is able to reduce the gaps and inconsistencies caused by the inaccurate boresight offsets between the two NAC cameras and the irregular overlapping regions and to finally generate precise and consistent 3D topographic models from the NAC stereo images.

[1]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Clive S. Fraser,et al.  Georeferencing Accuracy of GeoEye-1 imagery , 2009 .

[3]  James B. Garvin,et al.  Global Geometric Properties of Martian Impact Craters: A Preliminary Assessment Using Mars Orbiter Laser Altimeter (MOLA) , 1999 .

[4]  A. C. Cook,et al.  Clementine imagery: selenographic coverage for cartographic and scientific use , 1996 .

[5]  David E. Smith,et al.  A New Lunar Digital Elevation Model from the Lunar Orbiter Laser Altimeter and SELENE Terrain Camera , 2015 .

[6]  A. Verri,et al.  A compact algorithm for rectification of stereo pairs , 2000 .

[7]  Brent A. Archinal,et al.  Extracting accurate and precise topography from LROC narrow angle camera stereo observations , 2016 .

[8]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[9]  P. Thomas,et al.  Pre-flight and On-orbit Geometric Calibration of the Lunar Reconnaissance Orbiter Camera , 2016 .

[10]  Lionel Moisan,et al.  Automatic Homographic Registration of a Pair of Images, with A Contrario Elimination of Outliers , 2012, Image Process. Line.

[11]  Bo Wu,et al.  Co-registration of lunar topographic models derived from Chang’E-1, SELENE, and LRO laser altimeter data based on a novel surface matchingmethod , 2013 .

[12]  Charles T. Loop,et al.  Computing rectifying homographies for stereo vision , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[13]  Kaichang Di,et al.  Rigorous Photogrammetric Processing of HiRISE Stereo Imagery for Mars Topographic Mapping , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[16]  K. L. Edmundson,et al.  Generating digital terrain models using lroc nac images , 2010 .

[17]  Oleg Alexandrov,et al.  Automated and Accurate: Making DTMs from LRO-NAC Using the Ames Stereo Pipeline , 2014 .

[18]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[19]  Bo Wu,et al.  Calibration of boresight offset of LROC NAC imagery for precision lunar topographic mapping , 2017 .

[20]  Bo Wu,et al.  Integration of Chang'E-2 imagery and LRO laser altimeter data with a combined block adjustment for precision lunar topographic modeling , 2014 .

[21]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Charles K. Toth,et al.  A Piecewise Approach to Epipolar Resampling of Pushbroom Satellite Images Based on RPC , 2010 .

[23]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Mi Wang,et al.  Isprs Journal of Photogrammetry and Remote Sensing Epipolar Resampling of Linear Pushbroom Satellite Imagery by a New Epipolarity Model , 2022 .

[25]  Taejung Kim,et al.  A Study on the Epipolarity of Linear Pushbroom Images , 2000 .

[26]  David E. Smith,et al.  Mars Orbiter Laser Altimeter: Experiment summary after the first year of global mapping of Mars , 2001 .

[27]  J. Grodecki,et al.  Block Adjustment of High-Resolution Satellite Images Described by Rational Polynomials , 2003 .

[28]  Bo Wu,et al.  Integrated point and edge matching on poor textural images constrained by self-adaptive triangulations , 2012 .

[29]  A. McEwen,et al.  Lunar Reconnaissance Orbiter Camera (LROC) Instrument Overview , 2010 .

[30]  V. S. Scott,et al.  The Lunar Orbiter Laser Altimeter Investigation on the Lunar Reconnaissance Orbiter Mission , 2010 .

[31]  W. Watters,et al.  Morphometry of small recent impact craters on Mars: Size and terrain dependence, short‐term modification , 2015 .

[32]  Julien Michel,et al.  On stereo-rectification of pushbroom images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[33]  Bin Liu,et al.  A Self-Calibration Bundle Adjustment Method for Photogrammetric Processing of Chang $^{\prime}$E-2 Stereo Lunar Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Qing Zhu,et al.  Stable least-squares matching for oblique images using bound constrained optimization and a robust loss function , 2016 .