Integrating Deep-Learning-Based Image Completion and Motion Planning to Expedite Indoor Mapping

The challenge of autonomous indoor mapping is addressed. The goal is to minimize the time required to achieve a predefined percentage of coverage with some desired level of certainty. The use of a pre-trained generative deep neural network, acting as a map predictor, in both the motion planning and the map construction is proposed in order to expedite the mapping process. The issue of planning under partial observability is tackled by maintaining a belief map of the floorplan, generated by a deep neural network. This allows the agent to shorten the mapping duration, as well as enabling it to make better-informed decisions. This method is examined in combination with several motion planners for two distinct floorplan datasets. Simulations are run for several configurations of the integrated map predictor, the results of which reveal that by utilizing the prediction a significant reduction in mapping time is possible. When the prediction is integrated in both motion planning and map construction processes it is shown that the mapping time may in some cases be cut by over 50%.

[1]  Thomas S. Huang,et al.  Free-Form Image Inpainting With Gated Convolution , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  Ping Tan,et al.  Learned Map Prediction for Enhanced Mobile Robot Exploration , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[3]  Rajesh P. N. Rao,et al.  Learning deep generative spatial models for mobile robots , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Thomas S. Huang,et al.  Generative Image Inpainting with Contextual Attention , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Francesco Amigoni,et al.  Robot Exploration Using Knowledge of Inaccurate Floor Plans , 2019, 2019 European Conference on Mobile Robots (ECMR).

[6]  Mário S. Alvim,et al.  Information-Driven Rapidly-Exploring Random Tree for Efficient Environment Exploration , 2018, J. Intell. Robotic Syst..

[7]  Charles Blundell,et al.  Early Visual Concept Learning with Unsupervised Deep Learning , 2016, ArXiv.

[8]  Liu Ming,et al.  A robot exploration strategy based on Q-learning network , 2016 .

[9]  Deva Ramanan,et al.  Learning to Move with Affordance Maps , 2020, ICLR.

[10]  Zendai Kashino,et al.  Deep Reinforcement Learning Robot for Search and Rescue Applications: Exploration in Unknown Cluttered Environments , 2019, IEEE Robotics and Automation Letters.

[11]  S. Wirth,et al.  Exploration Transform: A stable exploring algorithm for robots in rescue environments , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[12]  Gregory D. Hager,et al.  Uncertainty-Aware Occupancy Map Prediction Using Generative Networks for Robot Navigation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[13]  Shi Bai,et al.  Toward autonomous mapping and exploration for mobile robots through deep supervised learning , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Hiroshi Ishikawa,et al.  Globally and locally consistent image completion , 2017, ACM Trans. Graph..

[15]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[16]  Max Q.-H. Meng,et al.  HouseExpo: A Large-scale 2D Indoor Layout Dataset for Learning-based Algorithms on Mobile Robots , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Ting-Chun Wang,et al.  Image Inpainting for Irregular Holes Using Partial Convolutions , 2018, ECCV.

[18]  Ming Liu,et al.  A robot exploration strategy based on Q-learning network , 2016, 2016 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Geoffrey A. Hollinger,et al.  Deep learning of structured environments for robot search , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Yu-Bin Yang,et al.  Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections , 2016, ArXiv.

[22]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[23]  Francesco Amigoni,et al.  Exploration of Indoor Environments Predicting the Layout of Partially Observed Rooms , 2020, ArXiv.