Path Planning for Active V-Slam Based on Reinforcement Learning

Slam (Simultaneous Localization and Mapping) is a passive system and in traditional slam algorithm robot’s path is not considered when improving localization uncertainty. However, improving localization accuracy while autonomously exploring unknown environments needs to get abundant feature points and make enough loop closures. To that end we propose a reinforcement learning based active slam framework that can add path planning to existing slam algorithms. In this framework a reinforcement learning agent plans the path while slam is processing. We have tested our framework in simulation environments built in Unreal engine with unrealcv plugin and we have got excellent results.

[1]  Rahul Sukthankar,et al.  Cognitive Mapping and Planning for Visual Navigation , 2017, International Journal of Computer Vision.

[2]  Rahul Sukthankar,et al.  Cognitive Mapping and Planning for Visual Navigation , 2017, International Journal of Computer Vision.

[3]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[4]  Shi Bai,et al.  Inference-Enabled Information-Theoretic Exploration of Continuous Action Spaces , 2015, ISRR.

[5]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[6]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[7]  Leslie Pack Kaelbling,et al.  Effective reinforcement learning for mobile robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[8]  Jaime Valls Miró,et al.  Active Pose SLAM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Risto Ritala,et al.  Planning for robotic exploration based on forward simulation , 2015, Robotics Auton. Syst..

[10]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[11]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[12]  Elman Mansimov,et al.  Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation , 2017, NIPS.

[13]  Yi Zhang,et al.  UnrealCV: Virtual Worlds for Computer Vision , 2017, ACM Multimedia.