An integrated photogrammetric and photoclinometric approach for illumination-invariant pixel-resolution 3D mapping of the lunar surface

Abstract High-resolution 3D information on lunar and planetary surfaces is crucial for planetary exploration missions and science. Photogrammetry is a state-of-the-art technology for generating 3D topographic models of surfaces such as digital elevation models (DEMs). The performance of the photogrammetry and the resulting DEMs is affected by image matching. However, most matching algorithms fail when the images have large differences in illumination and subtle textures. This problem can be addressed by integrating photoclinometry into the photogrammetric process. This paper presents an integrated photogrammetric and photoclinometric approach that is able to generate pixel-resolution DEMs of the lunar surface and is illumination invariant. The incorporation of photoclinometry into photogrammetry involves two main steps. First, a photoclinometry assisted image matching (PAM) approach is developed by integrating photometric stereo analysis in the image matching to create pixel-wise matches, even for images with large illumination differences. Second, the DEM derived from photogrammetry using the matching results is further refined to pixel-wise resolution using photoclinometry with a shadow constraint. The proposed approach has been used for high-resolution topographic mapping at the Chang’E-4 and Chang’E-5 landing sites using Lunar Reconnaissance Orbiter Camera (LROC) Narrow Angle Camera (NAC) images acquired under different illumination conditions. The results indicate that the proposed approach is robust to severe inconsistencies in illumination and subtle textures in cases where the conventional approaches fail. The approach is able to achieve geometric accuracies comparable to photogrammetry but more small-scale topographic details. The proposed approach can also be used for high-resolution topographic mapping of other planetary bodies such as Mercury or asteroids, and provides a useful reference for similar topographic mapping on Earth.

[1]  Bo Wu,et al.  Rock Abundance and Crater Density in the Candidate Chang'E‐5 Landing Region on the Moon , 2018, Journal of Geophysical Research: Planets.

[2]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[3]  Bruce Hapke,et al.  Bidirectional Reflectance Spectroscopy: 5. The Coherent Backscatter Opposition Effect and Anisotropic Scattering , 2002 .

[4]  B. Hapke Bidirectional reflectance spectroscopy: 4. The extinction coefficient and the opposition effect , 1986 .

[5]  B. Hapke Theory of reflectance and emittance spectroscopy , 1993 .

[6]  Peter Pirsch,et al.  Evaluation of Penalty Functions for Semi-Global Matching Cost Aggregation , 2012 .

[7]  Christian Wöhler,et al.  Construction of pixel-level resolution DEMs from monocular images by shape and albedo from shading constrained with low-resolution DEM , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[8]  Berthold K. P. Horn Height and gradient from shading , 1989, International Journal of Computer Vision.

[9]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[10]  B. Hapke Bidirectional reflectance spectroscopy: 1. Theory , 1981 .

[11]  Christian Heipke,et al.  Derivation of planetary topography using multi-image shape-from-shading , 2006 .

[12]  A. McEwen Photometric functions for photoclinometry and other applications , 1991 .

[13]  Wai Chung Liu,et al.  PHOTOMETRIC STEREO SHAPE-AND-ALBEDO-FROM-SHADING FOR PIXEL-LEVEL RESOLUTION LUNAR SURFACE RECONSTRUCTION , 2017 .

[14]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[15]  C. Wöhler,et al.  Integrated topographic, photometric and spectral analysis of the lunar surface: Application to impact melt flows and ponds , 2014 .

[16]  R. Kirk,et al.  High-resolution topomapping of candidate MER landing sites with Mars Orbiter Camera narrow-angle images , 2003 .

[17]  Christian Wöhler,et al.  Effects of illumination differences on photometric stereo shape-and-albedo-from-shading for precision lunar surface reconstruction , 2018 .

[18]  R. O'Hara,et al.  A new shape from shading technique with application to Mars Express HRSC images , 2012 .

[19]  Randolph L. Kirk,et al.  Meter‐scale slopes of candidate MER landing sites from point photoclinometry , 2003 .

[20]  Bo Wu,et al.  Block adjustment and coupled epipolar rectification of LROC NAC images for precision lunar topographic mapping , 2018, Planetary and Space Science.

[21]  Bo Wu,et al.  A Triangulation-based Hierarchical Image Matching Method for Wide-Baseline Images , 2011 .

[22]  Christian Wöhler,et al.  Hybrid method for crater detection based on topography reconstruction from optical images and the new LU78287GT catalogue of Lunar impact craters , 2014 .

[23]  Alexander Stark,et al.  Toward high-resolution global topography of Mercury from MESSENGER orbital stereo imaging: A prototype model for the H6 (Kuiper) quadrangle , 2016, 1608.08487.

[24]  Bo Wu,et al.  Calibration of boresight offset of LROC NAC imagery for precision lunar topographic mapping , 2017 .

[25]  J. Muller,et al.  Evaluating planetary digital terrain models - the HRSC DTM test , 2007 .

[26]  R. Beyer Meter-Scale Slopes of Candidate InSight Landing Sites from Point Photoclinometry , 2012 .

[27]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Daniel J. Scheeres,et al.  Characterizing and navigating small bodies with imaging data , 2006 .

[29]  C. Wöhler,et al.  Construction of lunar DEMs based on reflectance modelling , 2014 .

[30]  Bo Wu,et al.  Illumination invariant feature point matching for high-resolution planetary remote sensing images , 2018 .

[31]  Bo Wu,et al.  Integrated point and edge matching on poor textural images constrained by self-adaptive triangulations , 2012 .

[32]  C. H. Acton,et al.  Ancillary data services of NASA's Navigation and Ancillary Information Facility , 1996 .

[33]  Berthold K. P. Horn Understanding Image Intensities , 1977, Artif. Intell..

[34]  S. Jacquemoud,et al.  Surface roughness retrieval by inversion of the Hapke model: A multiscale approach , 2017 .

[35]  P. Thomas,et al.  Pre-flight and On-orbit Geometric Calibration of the Lunar Reconnaissance Orbiter Camera , 2016 .