Long-term mapping and localization using feature stability histograms

This work proposes a system for long-term mapping and localization based on the Feature Stability Histogram (FSH) model which is an innovative feature management approach able to cope with changing environments. FSH is built using a voting schema, where re-observed features are promoted; otherwise the feature progressively decreases its corresponding FSH value. FSH is inspired by the human memory model. This model introduces concepts of Short-Term Memory (STM), which retains information long enough to use it, and Long-Term Memory (LTM), which retains information for longer periods of time. If the entries in STM are continuously rehearsed, they become part of LTM. However, this work proposes a change in the pipeline of this model, allowing any feature to be part of STM or LTM depending on the feature strength. FSH stores the stability values of local features, stable features are only used for localization and mapping. Experimental validation of the FSH model was conducted using the FastSLAM framework and a long-term dataset collected during a period of one year at different environmental conditions. The experiments carried out include qualitative and quantitative results such as: filtering out dynamic objects, increasing map accuracy, scalability, and reducing the data association effort in long-term runs.

[1]  Juan Andrade-Cetto,et al.  Concurrent Map Building and Localization on Indoor Dynamic Environments , 2002, Int. J. Pattern Recognit. Artif. Intell..

[2]  Joaquim Salvi,et al.  Selective Submap Joining for underwater large scale 6-DOF SLAM , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Christian Schlegel,et al.  Landmark rating and selection according to localization coverage: Addressing the challenge of lifelong operation of SLAM in service robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[5]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[6]  Joaquim Salvi,et al.  Appearance-based mapping and localization for mobile robots using a feature stability histogram , 2011, Robotics Auton. Syst..

[7]  Y. Kuwata,et al.  Enabling continuous planetary rover navigation through FPGA stereo and visual odometry , 2012, 2012 IEEE Aerospace Conference.

[8]  Cyrill Stachniss,et al.  Lifelong Map Learning for Graph-based SLAM in Static Environments , 2010, KI - Künstliche Intelligenz.

[9]  Juan D. Tardós,et al.  Hierarchical SLAM: real-time accurate mapping of large environments , 2005, IEEE Transactions on Robotics.

[10]  Pascal Vasseur,et al.  Fast Central Catadioptric Line Extraction , 2007, IbPRIA.

[11]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[12]  Christian Laugier,et al.  Autonomous Navigation in Dynamic Environments , 2007 .

[13]  Wolfram Burgard,et al.  Online constraint network optimization for efficient maximum likelihood map learning , 2008, 2008 IEEE International Conference on Robotics and Automation.

[14]  Grzegorz Cielniak,et al.  An Adaptive Spherical View Representation for Navigation in Changing Environments , 2009, ECMR.

[15]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[16]  Kai Oliver Arras,et al.  FLIRT - Interest regions for 2D range data , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Horst Bischof,et al.  CD SLAM - continuous localization and mapping in a dynamic world , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[19]  Thomas B. Schön,et al.  Learning to close loops from range data , 2011, Int. J. Robotics Res..

[20]  Tom Duckett,et al.  Experimental Analysis of Sample-Based Maps for Long-Term SLAM , 2009, Int. J. Robotics Res..

[21]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[22]  Helder Araújo,et al.  Geometric properties of central catadioptric line images and their application in calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  R. Llinás I of the Vortex: From Neurons to Self , 2000 .

[24]  Shuo Xu,et al.  Towards robust personal assistant robots: Experience gained in the SRS project , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Klaus-Dieter Althoff Künstliche Intelligenz ab 2010 bei Springer , 2010, KI - Künstliche Intelligenz.

[26]  Ian D. Reid,et al.  An image-to-map loop closing method for monocular SLAM , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Hugh F. Durrant-Whyte,et al.  A computationally efficient solution to the simultaneous localisation and map building (SLAM) problem , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[28]  Gordon Wyeth,et al.  FAB-MAP + RatSLAM: Appearance-based SLAM for multiple times of day , 2010, 2010 IEEE International Conference on Robotics and Automation.

[29]  Hasnan Bin Khalid,et al.  A Review of Photo Sensor Laser Range Finder Hokuyo URG-04LX-UG01 Applications , 2012 .

[30]  B. Caputo,et al.  Cold: the Cosy Localization Database Cold: the Cosy Localization Database , 2009 .

[31]  Kurt Konolige,et al.  Towards lifelong visual maps , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[33]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  El Mustapha Mouaddib,et al.  Range information in omnidirectional images through laser range finder , 2010 .

[35]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[36]  Sebastian Thrun,et al.  Online simultaneous localization and mapping with detection and tracking of moving objects: theory and results from a ground vehicle in crowded urban areas , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[37]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[38]  William Rucklidge,et al.  Efficient Visual Recognition Using the Hausdorff Distance , 1996, Lecture Notes in Computer Science.

[39]  Joaquim Salvi,et al.  Vertical edge-based mapping using range-augmented omnidirectional vision sensor , 2013, IET Comput. Vis..

[40]  Pere Ridao,et al.  Visual inspection of hydroelectric dams using an autonomous underwater vehicle , 2010, J. Field Robotics.

[41]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[42]  Gordon Wyeth,et al.  Persistent Navigation and Mapping using a Biologically Inspired SLAM System , 2010, Int. J. Robotics Res..

[43]  Ian D. Reid,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems a Comparison of Loop Closing Techniques in Monocular Slam , 2022 .

[44]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[45]  François Michaud,et al.  Memory management for real-time appearance-based loop closure detection , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Wolfram Burgard,et al.  Mobile Robot Map Learning from Range Data in Dynamic Environments , 2007 .

[47]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.