Panoramic Mosaics from Chang'E-3 PCAM Images at Point A

This paper presents a unique approach for panoramic mosaics based on Moon surface images from the Chang’E-3 (CE-3) mission, with consideration of the exposure time and external illumination changes in CE-3 Panoramic Camera (PCAM) imaging. The engineering implementation involves algorithms of image feature points extraction by using Speed-Up Robust Features (SURF), and a newly defined measure is used to obtain the corresponding points in feature matching. Then, the transformation matrix is calculated and optimized between adjacent images by the Levenberg–Marquardt algorithm. Finally, an image is reconstructed by using a fade-in-fade-out method based on linear interpolation to achieve a seamless mosaic. The developed algorithm has been tested with CE-3 PCAM images at Point A (one of the rover sites where the rover is separated from the lander). This approach has produced accurate mosaics from CE-3 PCAM images, as is indicated by the value of the Peak Signal to Noise Ratio (PSNR), which is greater than 31 dB between the overlapped region of the images before and after fusion.

[1]  Chunlai Li,et al.  Terrain reconstruction from Chang'e-3 PCAM images , 2015 .

[2]  Ralf Widenhorn,et al.  Dark current in an active pixel complementary metal-oxide-semiconductor sensor , 2011, J. Electronic Imaging.

[3]  Hans P. Moravec.  Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[4]  Chong-Wah Ngo,et al.  Motion analysis and segmentation through spatio-temporal slices processing , 2003, IEEE Trans. Image Process..

[5]  Manchun Li,et al.  Parallel relative radiometric normalisation for remote sensing image mosaics , 2014, Comput. Geosci..

[6]  Chunlai Li,et al.  A method and results of color calibration for the Chang'e-3 terrain camera and panoramic camera , 2014 .

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[9]  Bo Wang,et al.  Automatic Registration Method for Fusion of ZY-1-02C Satellite Images , 2013, Remote. Sens..

[10]  Yang Li,et al.  An ASIFT-Based Local Registration Method for Satellite Imagery , 2015, Remote. Sens..

[11]  Aleksandra Anna Sima,et al.  Optimizing SIFT for Matching of Short Wave Infrared and Visible Wavelength Images , 2013, Remote. Sens..

[12]  吴凡路 Wu Fanlu,et al.  Deep Space Exploration Panoramic Camera Calibration Technique Based on Circular Markers , 2013 .

[13]  Q. M. Jonathan Wu,et al.  A comparative experimental study of image feature detectors and descriptors , 2015, Machine Vision and Applications.

[14]  D. Ming,et al.  Pancam Multispectral Imaging Results from the Opportunity Rover at Meridiani Planum , 2004, Science.

[15]  Albert Y. Zomaya,et al.  Task-Tree Based Large-Scale Mosaicking for Massive Remote Sensed Imageries with Dynamic DAG Scheduling , 2014, IEEE Transactions on Parallel and Distributed Systems.

[16]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[17]  A. Yingst,et al.  A Habitable Fluvio-Lacustrine Environment at Yellowknife Bay, Gale Crater, Mars , 2014, Science.

[18]  D. Ming,et al.  Pancam Multispectral Imaging Results from the Spirit Rover at Gusev Crater , 2004, Science.

[19]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[20]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[21]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .

[22]  Ralf Widenhorn,et al.  Correction of dark current in consumer cameras , 2010, J. Electronic Imaging.

[23]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[24]  Boris Jutzi,et al.  Improved Feature Detection in Fused Intensity-Range Images with Complex SIFT (ℂSIFT) , 2011, Remote. Sens..

[25]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[26]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[28]  King-To Ng,et al.  A virtual reality system using the concentric mosaic: construction, rendering, and data compression , 2005, IEEE Transactions on Multimedia.

[29]  R. V. Morris,et al.  Curiosity at Gale Crater, Mars: Characterization and Analysis of the Rocknest Sand Shadow , 2013, Science.

[30]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[31]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[32]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[33]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[34]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[35]  W. Ip,et al.  Preface: The Chang'e-3 lander and rover mission to the Moon , 2014 .

[36]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..