Learned Map Prediction for Enhanced Mobile Robot Exploration

We demonstrate an autonomous ground robot capable of exploring unknown indoor environments for reconstructing their 2D maps. This problem has been traditionally tackled by geometric heuristics and information theory. More recently, deep learning and reinforcement learning based approaches have been proposed to learn exploration behavior in an end-to-end manner. We present a method that combines the strengths of these different approaches. Specifically, we employ a state-of-the-art generative neural network to predict unknown regions of a partially explored map, and use the prediction to enhance the exploration in an information-theoretic manner. We evaluate our system in simulation using floor plans of real buildings. We also present comparisons with traditional methods which demonstrate the advantage of our method in terms of exploration efficiency. We retain an advantage over end-to-end learned exploration methods in that the robot’s behavior is easily explicable in terms of the predicted map.

[1]  Arturo Gil,et al.  A comparison of path planning strategies for autonomous exploration and mapping of unknown environments , 2012, Auton. Robots.

[2]  Honglak Lee,et al.  Control of Memory, Active Perception, and Action in Minecraft , 2016, ICML.

[3]  Pedro M. Domingos,et al.  Sum-product networks: A new deep architecture , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  Oskar von Stryk,et al.  Hector Open Source Modules for Autonomous Mapping and Navigation with Rescue Robots , 2013, RoboCup.

[5]  Sebastian Thrun,et al.  A Probabilistic On-Line Mapping Algorithm for Teams of Mobile Robots , 2001, Int. J. Robotics Res..

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[8]  Ian D. Reid,et al.  On the comparison of uncertainty criteria for active SLAM , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Razvan Pascanu,et al.  Learning to Navigate in Complex Environments , 2016, ICLR.

[10]  Jaime Valls Miró,et al.  Mutual information-based exploration on continuous occupancy maps , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.

[12]  Rahul Sukthankar,et al.  Cognitive Mapping and Planning for Visual Navigation , 2017, International Journal of Computer Vision.

[13]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[14]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[15]  S. Wirth,et al.  Exploration Transform: A stable exploring algorithm for robots in rescue environments , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[16]  Richard Vaughan,et al.  Massively multi-robot simulation in stage , 2008, Swarm Intelligence.

[17]  Rajesh P. N. Rao,et al.  Learning deep generative spatial models for mobile robots , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Hiroshi Ishikawa,et al.  Globally and locally consistent image completion , 2017, ACM Trans. Graph..

[19]  Shi Bai,et al.  Toward autonomous mapping and exploration for mobile robots through deep supervised learning , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Wolfram Burgard,et al.  Neural SLAM , 2017, ArXiv.

[21]  Benmouiza Khalil,et al.  Density-based spatial clustering of application with noise algorithm for the classification of solar radiation time series , 2016, 2016 8th International Conference on Modelling, Identification and Control (ICMIC).

[22]  Tai Lei A Robot Exploration Strategy Based on Q-learning Network , 2016 .

[23]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[24]  John Folkesson,et al.  What can we learn from 38,000 rooms? Reasoning about unexplored space in indoor environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Rajesh P. N. Rao,et al.  Deep Spatial Affordance Hierarchy : Spatial Knowledge Representation for Planning in Large-scale Environments , 2017 .

[26]  Cyrill Stachniss,et al.  Predictive exploration considering previously mapped environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[28]  Cyrill Stachniss,et al.  Robust exploration and homing for autonomous robots , 2017, Robotics Auton. Syst..

[29]  Jianwei Zhang,et al.  3D scene reconstruction based on a moving 2D laser range finder for service-robots , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[30]  Qian Zhang,et al.  Active Camera Relocalization from a Single Reference Image without Hand-Eye Calibration , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Samuel Gershman,et al.  Deep Successor Reinforcement Learning , 2016, ArXiv.

[32]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[33]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[34]  Wei Feng,et al.  Fast and Reliable Computational Rephotography on Mobile Device , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[35]  Shi Bai,et al.  Information-theoretic exploration with Bayesian optimization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Frank P. Ferrie,et al.  Autonomous exploration: driven by uncertainty , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Masumi Ishikawa,et al.  A study of an autonomous mobile robot for a sewer inspection system , 2007, Artificial Life and Robotics.

[38]  Héctor H. González-Baños,et al.  Navigation Strategies for Exploring Indoor Environments , 2002, Int. J. Robotics Res..

[39]  W. Boothby An introduction to differentiable manifolds and Riemannian geometry , 1975 .

[40]  Welch Bl THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[41]  Alberto Elfes,et al.  Robot Navigation: Integrating Perception, Environmental Constraints and Task Execution Within a Probabilistic Framework , 1995, Reasoning with Uncertainty in Robotics.

[42]  Kyohei Otsu,et al.  Where to Look? Predictive Perception With Applications to Planetary Exploration , 2018, IEEE Robotics and Automation Letters.

[43]  Ping Tan,et al.  Active Recurrence of Lighting Condition for Fine-Grained Change Detection , 2018, IJCAI.

[44]  Alexei Makarenko,et al.  Information based adaptive robotic exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Mário S. Alvim,et al.  Information-Driven Rapidly-Exploring Random Tree for Efficient Environment Exploration , 2018, J. Intell. Robotic Syst..

[46]  Juan Andrade-Cetto,et al.  Potential information fields for mobile robot exploration , 2015, Robotics Auton. Syst..

[47]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[48]  Minh N. Do,et al.  Semantic Image Inpainting with Deep Generative Models , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Shayok Mukhopadhyay,et al.  Autonomous robotic exploration based on multiple rapidly-exploring randomized trees , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[50]  Ashish Sharma,et al.  An Enhanced Density Based Spatial Clustering of Applications with Noise , 2009, 2009 IEEE International Advance Computing Conference.

[51]  Wolfram Burgard,et al.  Gaussian mixture models for probabilistic localization , 2008, 2008 IEEE International Conference on Robotics and Automation.

[52]  Alexander Ferrein,et al.  Towards a Mobile Mapping Robot for Underground Mines , .

[53]  Graham W. Taylor,et al.  Deconvolutional networks , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[54]  Thomas S. Huang,et al.  Generative Image Inpainting with Contextual Attention , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[55]  C E Shannon,et al.  The mathematical theory of communication. 1963. , 1997, M.D. computing : computers in medical practice.