Introducing a globally consistent orbital‐based localization system

In spite of the good performance of space exploratory missions, open issues still await to be solved. In autonomous or composite semi-autonomous exploration of planetary land surfaces, rover localization is such an issue. The rovers of these missions (e.g., the MER and MSL) navigate relatively to their landing spot, ignoring their exact position on the coordinate system defined for the celestial body they explore. However, future advanced missions, like the Mars Sample Return, will require the localization of rovers on a global frame rather than the arbitrarily defined landing frame. In this paper we attempt to retrieve the absolute rover's location by identifying matching Regions of Interest (ROIs) between orbital and land images. In particular, we propose a system comprising two parts, an offline and an onboard one, which functions as follows: in advance of the mission a Global ROI Network (GN) is built offline by investigating the satellite images near the predicted touchdown ellipse, while during the mission a Local ROI Network (LN) is constructed counting on the images acquired by the vision system of the rover along its traverse. The last procedure relies on the accurate VO-based relative rover localization. The LN is then paired with the GN through a modified 2D DARCES algorithm. The system has been assessed on real data collected by the ESA at the Atacama desert. The results demonstrate the system's potential to perform absolute localization, on condition that the area includes discriminative ROIs. The main contribution of this work is the enablement of global localization performed on contemporary rovers without requiring any additional hardware, such as long range LIDARs.

[1]  John Enright,et al.  Sun Sensor Navigation for Planetary Rovers: Theory and Field Testing , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[2]  Timothy D. Barfoot,et al.  Long-range rover localization by matching LIDAR scans to orbital elevation maps , 2010 .

[3]  Keith Yu Kit Leung,et al.  Localization in urban environments by matching ground level video images with an aerial image , 2008, 2008 IEEE International Conference on Robotics and Automation.

[4]  K. Di,et al.  Mars Rover Localization based on Feature Matching between Ground and Orbital Imagery , 2011 .

[5]  Jun Peng,et al.  An Efficient KNN Algorithm Implemented on FPGA Based Heterogeneous Computing System Using OpenCL , 2015, 2015 IEEE 23rd Annual International Symposium on Field-Programmable Custom Computing Machines.

[6]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[7]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[8]  John Enright,et al.  Visual odometry aided by a sun sensor and inclinometer , 2011, 2011 Aerospace Conference.

[9]  Yi-Ping Hung,et al.  RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  James R. Bergen,et al.  Visual odometry for ground vehicle applications , 2006, J. Field Robotics.

[11]  F. Gianfelici,et al.  Nearest-Neighbor Methods in Learning and Vision (Shakhnarovich, G. et al., Eds.; 2006) [Book review] , 2008 .

[12]  D. Tholen,et al.  Report of the IAU Working Group on Cartographic Coordinates and Rotational Elements: 2009 , 2011 .

[13]  Christopher P. McKay,et al.  Mars-Like Soils in the Atacama Desert, Chile, and the Dry Limit of Microbial Life , 2003, Science.

[14]  Antonios Gasteratos,et al.  Modeling Regions of Interest on Orbital and Rover Imagery for Planetary Exploration Missions , 2016, Cybern. Syst..

[15]  Sridha Sridharan,et al.  Hessian-Based Affine Adaptation of Salient Local Image Features , 2012, Journal of Mathematical Imaging and Vision.

[16]  Daniel M. Helmick,et al.  Autonomy for Mars Rovers: Past, Present, and Future , 2008, Computer.

[17]  Paul Timothy Furgale,et al.  A comparison of global localization algorithms for planetary exploration , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Gérard G. Medioni,et al.  Map-based localization using the panoramic horizon , 1995, IEEE Trans. Robotics Autom..

[19]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[20]  K. Di,et al.  Initial results of rover localization and topographic mapping for the 2003 mars exploration rover mission , 2005 .

[21]  Jake K. Aggarwal,et al.  Position estimation for an autonomous mobile robot in an outdoor environment , 1992, IEEE Trans. Robotics Autom..

[22]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[23]  Andrew E. Johnson,et al.  Opportunity rover localization and topographic mapping at the landing site of Meridiani Planum, Mars , 2007 .

[24]  Wolfram Burgard,et al.  Large scale graph-based SLAM using aerial images as prior information , 2009, Auton. Robots.

[25]  Manolis I. A. Lourakis,et al.  SPARTAN/SEXTANT/COMPASS: Advancing Space Rover Vision via Reconfigurable Platforms , 2015, ARC.

[26]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[28]  Mark Woods,et al.  Terrain Adaptive Navigation for planetary rovers , 2009 .

[29]  K. Di,et al.  Spirit rover localization and topographic mapping at the landing site of Gusev crater, Mars , 2006 .

[30]  Clark F. Olson,et al.  Localization of Mars rovers using descent and surface‐based image data , 2002 .

[31]  Tim D. Barfoot,et al.  Global rover localization by matching lidar and orbital 3D maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[32]  Larry H. Matthies,et al.  Two years of Visual Odometry on the Mars Exploration Rovers , 2007, J. Field Robotics.

[33]  Dimitrios Soudris,et al.  SPARTAN: Developing a Vision System for Future Autonomous Space Exploration Robots , 2014, J. Field Robotics.

[34]  Eric Krotkov,et al.  Outdoor Visual Position Estimation for Planetary Rovers , 2000, Auton. Robots.

[35]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[36]  Antonios Gasteratos,et al.  Visual Odometry for autonomous robot navigation through efficient outlier rejection , 2013, 2013 IEEE International Conference on Imaging Systems and Techniques (IST).

[37]  Fabio Gagliardi Cozman,et al.  Robot localization using a computer vision sextant , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[38]  Larry H. Matthies,et al.  Rock modeling and matching for autonomous long‐range Mars rover localization , 2007, J. Field Robotics.

[39]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  William E. Higgins,et al.  Efficient Gabor filter design for texture segmentation , 1996, Pattern Recognit..

[41]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[42]  Jeffrey J. Biesiadecki,et al.  Attitude and position estimation on the Mars exploration rovers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[43]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[44]  David Nistér,et al.  Linear Time Maximally Stable Extremal Regions , 2008, ECCV.

[45]  Jong-Sen Lee,et al.  Digital image smoothing and the sigma filter , 1983, Comput. Vis. Graph. Image Process..