Predictive and adaptive maps for long-term visual navigation in changing environments

In this paper, we compare different map management techniques for long-term visual navigation in changing environments. In this scenario, the navigation system needs to continuously update and refine its feature map in order to adapt to the environment appearance change. To achieve reliable long-term navigation, the map management techniques have to (i) select features useful for the current navigation task, (ii) remove features that are obsolete, (iii) and add new features from the current camera view to the map. We propose several map management strategies and evaluate their performance with regard to the robot localisation accuracy in long-term teach-and-repeat navigation. Our experiments, performed over three months, indicate that strategies which model cyclic changes of the environment appearance and predict which features are going to be visible at a particular time and location, outperform strategies which do not explicitly model the temporal evolution of the changes.

[1]  Tom Duckett,et al.  An adaptive appearance-based map for long-term topological localization of mobile robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Paul Newman,et al.  Checkout my map: Version control for fleetwide visual localisation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  John J. Leonard,et al.  Towards lifelong feature-based mapping in semi-static environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Michael Bosse,et al.  Summary Maps for Lifelong Visual Localization , 2016, J. Field Robotics.

[5]  Tom Duckett,et al.  Image features for visual teach-and-repeat navigation in changing environments , 2017, Robotics Auton. Syst..

[6]  Paul Newman,et al.  1 year, 1000 km: The Oxford RobotCar dataset , 2017, Int. J. Robotics Res..

[7]  Achim J. Lilienthal,et al.  SIFT, SURF & seasons: Appearance-based long-term localization in outdoor environments , 2010, Robotics Auton. Syst..

[8]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[9]  Tom Duckett,et al.  Dynamic Maps for Long-Term Operation of Mobile Service Robots , 2005, Robotics: Science and Systems.

[10]  Libor Preucil,et al.  Monocular navigation for long-term autonomy , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[11]  Tim D. Barfoot,et al.  I Can See for Miles and Miles: An Extended Field Test of Visual Teach and Repeat 2.0 , 2017, FSR.

[12]  Tom Duckett,et al.  A multilevel relaxation algorithm for simultaneous localization and mapping , 2005, IEEE Transactions on Robotics.

[13]  Jan Faigl,et al.  Navigation without localisation: reliable teach and repeat based on the convergence theorem , 2017, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Michael Milford,et al.  Addressing Challenging Place Recognition Tasks Using Generative Adversarial Networks , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Yassine Ruichek,et al.  EU Long-term Dataset with Multiple Sensors for Autonomous Driving , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Paul Newman,et al.  Work smart, not hard: Recalling relevant experiences for vast-scale but time-constrained localisation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Micael S. Couceiro,et al.  A Versatile Visual Navigation System for Autonomous Vehicles , 2018, MESAS.

[18]  Libor Preucil,et al.  A Practical Multirobot Localization System , 2014, J. Intell. Robotic Syst..

[19]  Tom Duckett,et al.  FreMEn: Frequency Map Enhancement for Long-Term Mobile Robot Autonomy in Changing Environments , 2017, IEEE Transactions on Robotics.

[20]  Paul Newman,et al.  Adversarial Training for Adverse Conditions: Robust Metric Localisation Using Appearance Transfer , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Michael Milford,et al.  Supervised and Unsupervised Linear Learning Techniques for Visual Place Recognition in Changing Environments , 2016, IEEE Transactions on Robotics.

[22]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[23]  Jeffrey K. Uhlmann,et al.  A counter example to the theory of simultaneous localization and map building , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[24]  Winston Churchill,et al.  Experience-based navigation for long-term localisation , 2013, Int. J. Robotics Res..

[25]  Libor Preucil,et al.  Simple yet stable bearing-only navigation , 2010, J. Field Robotics.

[26]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[27]  Roland Siegwart,et al.  Map Management for Efficient Long-Term Visual Localization in Outdoor Environments , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[28]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[29]  Alexander Zelinsky,et al.  Mobile robotics in the long term-exploring the fourth dimension , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[30]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[31]  Niko Sünderhauf,et al.  Appearance change prediction for long-term navigation across seasons , 2013, 2013 European Conference on Mobile Robots.

[32]  François Pomerleau,et al.  In the Dead of Winter: Challenging Vision-Based Path Following in Extreme Conditions , 2015, FSR.

[33]  Paul Timothy Furgale,et al.  Visual teach and repeat for long‐range rover autonomy , 2010, J. Field Robotics.

[34]  Marc Hanheide,et al.  Artificial Intelligence for Long-Term Robot Autonomy: A Survey , 2018, IEEE Robotics and Automation Letters.

[35]  Michael Warren,et al.  Bridging the appearance gap: Multi-experience localization for long-term visual teach and repeat , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Tim D. Barfoot,et al.  Selective memory: Recalling relevant experience for long‐term visual localization , 2018, J. Field Robotics.