A Light Visual Mapping and Navigation Framework for Low-Cost Robots

Abstract We address the problems of localization, mapping, and guidance for robots with limited computational resources by combining vision with the metrical information given by the robot odometry. We propose in this article a novel light and robust topometric simultaneous localization and mapping framework using appearance-based visual loop-closure detection enhanced with the odometry. The main advantage of this combination is that the odometry makes the loop-closure detection more accurate and reactive, while the loop-closure detection enables the long-term use of odometry for guidance by correcting the drift. The guidance approach is based on qualitative localization using vision and odometry, and is robust to visual sensor occlusions or changes in the scene. The resulting framework is incremental, real-time, and based on cheap sensors provided on many robots (a camera and odometry encoders). This approach is, moreover, particularly well suited for low-power robots as it is not dependent on the image processing frequency and latency, and thus it can be applied using remote processing. The algorithm has been validated on a Pioneer P3DX mobile robot in indoor environments, and its robustness is demonstrated experimentally for a large range of odometry noise levels.

[1]  Jana Kosecka,et al.  Global localization and relative positioning based on scale-invariant keypoints , 2005, Robotics Auton. Syst..

[2]  Luc Van Gool,et al.  Omnidirectional Vision Based Topological Navigation , 2007, International Journal of Computer Vision.

[3]  Ian D. Reid,et al.  Adaptive relative bundle adjustment , 2009, Robotics: Science and Systems.

[4]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[5]  David Filliat,et al.  Qualitative Localization using Vision and Odometry for Path Following in Topo-metric Maps , 2011, ECMR.

[6]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[7]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[8]  Tom Duckett,et al.  A multilevel relaxation algorithm for simultaneous localization and mapping , 2005, IEEE Transactions on Robotics.

[9]  Á. Soto,et al.  Active Visual Perception for Mobile Robot Localization , 2010, J. Intell. Robotic Syst..

[10]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jean-Arcady Meyer,et al.  Global localization and topological map-learning for robot navigation , 2002 .

[12]  Niko Sünderhauf,et al.  Towards a robust back-end for pose graph SLAM , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Sinisa Segvic,et al.  Outdoor visual path following experiments , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  David Filliat,et al.  Incremental topo-metric SLAM using vision and robot odometry , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Edwin Olson,et al.  Fast iterative alignment of pose graphs with poor initial estimates , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  J. Mixter.  Fast , 2012 .

[17]  Jean-Arcady Meyer,et al.  Real-time visual loop-closure detection , 2008, 2008 IEEE International Conference on Robotics and Automation.

[18]  Josechu J. Guerrero,et al.  Visual correction for mobile robot homing , 2005, Robotics Auton. Syst..

[19]  Ben J. A. Kröse,et al.  Hierarchical map building using visual landmarks and geometric constraints , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Maria L. Gini,et al.  Using visual features to build topological maps of indoor environments , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[21]  M.H. Ang,et al.  Appearance-based SLAM with map loop closing using an omnidirectional camera , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[22]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Tom Duckett,et al.  Incremental Spectral Clustering and Its Application To Topological Mapping , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[24]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[25]  Stephen R. Marsland,et al.  Fast, On-Line Learning of Globally Consistent Maps , 2002, Auton. Robots.

[26]  Javier González,et al.  Subjective local maps for hybrid metric-topological SLAM , 2009, Robotics Auton. Syst..

[27]  Friedrich Fraundorfer,et al.  Topological mapping, localization and navigation using image collections , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping with fluid relinearization and incremental variable reordering , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Gaurav S. Sukhatme,et al.  Relaxation on a mesh: a formalism for generalized localization , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[30]  Zhichao Chen,et al.  Qualitative Vision-Based Path Following , 2009, IEEE Transactions on Robotics.

[31]  Aram Kawewong,et al.  PIRF-Nav 2.0: Fast and online incremental appearance-based loop-closure detection in an indoor environment , 2011, Robotics Auton. Syst..

[32]  Wolfram Burgard,et al.  A Tree Parameterization for Efficiently Computing Maximum Likelihood Maps using Gradient Descent , 2007, Robotics: Science and Systems.

[33]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[34]  Tom Drummond,et al.  Monocular SLAM as a Graph of Coalesced Observations , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[35]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[36]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[37]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[38]  Darius Burschka,et al.  Vision-based control of mobile robots , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[39]  Ben J. A. Kröse,et al.  Navigation using an appearance based topological map , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[40]  Gordon Wyeth,et al.  Persistent Navigation and Mapping using a Biologically Inspired SLAM System , 2010, Int. J. Robotics Res..

[41]  Jean-Arcady Meyer,et al.  Fast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words , 2008, IEEE Transactions on Robotics.

[42]  Dorian Gálvez-López,et al.  Real-time loop detection with bags of binary words , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[44]  Guosheng Yang,et al.  Uncalibrated monocular based simultaneous localization and mapping for indoor autonomous mobile robot navigation , 2009, 2009 International Conference on Networking, Sensing and Control.

[45]  James R. Bergen,et al.  Visual odometry for ground vehicle applications , 2006, J. Field Robotics.