Topological local-metric framework for mobile robots navigation: a long term perspective

Long term mapping and localization are the primary components for mobile robots in real world application deployment, of which the crucial challenge is the robustness and stability. In this paper, we introduce a topological local-metric framework (TLF), aiming at dealing with environmental changes, erroneous measurements and achieving constant complexity. TLF organizes the sensor data collected by the robot in a topological graph, of which the geometry is only encoded in the edge, i.e. the relative poses between adjacent nodes, relaxing the global consistency to local consistency. Therefore the TLF is more robust to unavoidable erroneous measurements from sensor information matching since the error is constrained in the local. Based on TLF, as there is no global coordinate, we further propose the localization and navigation algorithms by switching across multiple local metric coordinates. Besides, a lifelong memorizing mechanism is presented to memorize the environmental changes in the TLF with constant complexity, as no global optimization is required. In experiments, the framework and algorithms are evaluated on 21-session data collected by stereo cameras, which are sensitive to illumination, and compared with the state-of-art global consistent framework. The results demonstrate that TLF can achieve similar localization accuracy with that from global consistent framework, but brings higher robustness with lower cost. The localization performance can also be improved from sessions because of the memorizing mechanism. Finally, equipped with TLF, the robot navigates itself in a 1 km session autonomously.

[1]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[2]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  François Pomerleau,et al.  Expanding the Limits of Vision-based Localization for Long-term Route-following Autonomy , 2017, J. Field Robotics.

[5]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[6]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  Rong Xiong,et al.  Kullback-leibler divergence based graph pruning in robotic feature mapping , 2013, 2013 European Conference on Mobile Robots.

[8]  Hanumant Singh,et al.  Exactly Sparse Delayed-State Filters for View-Based SLAM , 2006, IEEE Transactions on Robotics.

[9]  Yasir Latif,et al.  Robust loop closing over time for pose graph SLAM , 2013, Int. J. Robotics Res..

[10]  Rong Xiong,et al.  A framework for multi-session RGBD SLAM in low dynamic workspace environment , 2016, CAAI Trans. Intell. Technol..

[11]  Roland Siegwart,et al.  Lighting‐invariant Adaptive Route Following Using Iterative Closest Point Matching , 2015, J. Field Robotics.

[12]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[13]  Jean-Arcady Meyer,et al.  Visual topological SLAM and global localization , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  Tetsuya Ogata Special Issue on Cutting Edge of Robotics in Japan 2015 , 2015, Adv. Robotics.

[15]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[16]  Winston Churchill,et al.  Experience-based navigation for long-term localisation , 2013, Int. J. Robotics Res..

[17]  Peter K. Allen,et al.  Topological mobile robot localization using fast vision techniques , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[18]  Howie Choset,et al.  A unified Bayesian framework for global localization and SLAM in hybrid metric/topological maps , 2012, Int. J. Robotics Res..

[19]  Stergios I. Roumeliotis,et al.  A First-Estimates Jacobian EKF for Improving SLAM Consistency , 2009, ISER.

[20]  Paul Timothy Furgale,et al.  Visual teach and repeat for long‐range rover autonomy , 2010, J. Field Robotics.

[21]  John J. Leonard,et al.  Dynamic pose graph SLAM: Long-term mapping in low dynamic environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[23]  Michael Warren,et al.  Bridging the appearance gap: Multi-experience localization for long-term visual teach and repeat , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Markus Maurer,et al.  Local Volumetric Hybrid-Map-Based Simultaneous Localization and Mapping With Moving Object Tracking , 2016, IEEE Transactions on Intelligent Transportation Systems.

[25]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[26]  Gamini Dissanayake,et al.  Convergence and Consistency Analysis for Extended Kalman Filter Based SLAM , 2007, IEEE Transactions on Robotics.

[27]  Gregory Dudek,et al.  A global topological map formed by local metric maps , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[28]  Hugh F. Durrant-Whyte,et al.  A computationally efficient solution to the simultaneous localisation and map building (SLAM) problem , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[29]  Adam C. Winstanley,et al.  Background Foreground Segmentation for SLAM , 2011, IEEE Transactions on Intelligent Transportation Systems.

[30]  John J. Leonard,et al.  Real-time 6-DOF multi-session visual SLAM over large-scale environments , 2013, Robotics Auton. Syst..

[31]  Marc Pollefeys,et al.  Robust pose-graph loop-closures with expectation-maximization , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[33]  Paul Newman,et al.  Shady dealings: Robust, long-term visual localisation using illumination invariance , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Dorian Gálvez-López,et al.  Robust Place Recognition With Stereo Sequences , 2012, IEEE Transactions on Robotics.

[35]  Stergios I. Roumeliotis,et al.  Observability-based Rules for Designing Consistent EKF SLAM Estimators , 2010, Int. J. Robotics Res..

[36]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[37]  Stergios I. Roumeliotis,et al.  Appearance-based mapping using minimalistic sensor models , 2008, Auton. Robots.

[38]  Paul Newman,et al.  Learning place-dependant features for long-term vision-based localisation , 2015, Auton. Robots.

[39]  Paul Newman,et al.  Navigating, Recognizing and Describing Urban Spaces With Vision and Lasers , 2009, Int. J. Robotics Res..

[40]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[41]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[42]  Roland Siegwart,et al.  The role of homing in visual topological navigation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Martin Lauer,et al.  A Train Localization Algorithm for Train Protection Systems of the Future , 2015, IEEE Transactions on Intelligent Transportation Systems.

[44]  Paul Newman,et al.  FARLAP: Fast robust localisation using appearance priors , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[46]  Paul Timothy Furgale,et al.  Lighting‐invariant Visual Teach and Repeat Using Appearance‐based Lidar , 2013, J. Field Robotics.

[47]  Michael Kaess,et al.  Generic Node Removal for Factor-Graph SLAM , 2014, IEEE Transactions on Robotics.

[48]  Yiyi Liao,et al.  Graph Regularized Auto-Encoders for Image Representation , 2017, IEEE Transactions on Image Processing.

[49]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[50]  Gaurav S. Sukhatme,et al.  Mobile Robot Simultaneous Localization and Mapping in Dynamic Environments , 2005, Auton. Robots.

[51]  Kurt Konolige,et al.  Navigation in hybrid metric-topological maps , 2011, 2011 IEEE International Conference on Robotics and Automation.

[52]  Rong Xiong,et al.  A pose pruning driven solution to pose feature GraphSLAM , 2015, Adv. Robotics.