Loop Closure Detection for Visual SLAM Fusing Semantic Information

Loop closure detection is of great significance to Visual Simultaneous Localization and Mapping (SLAM) system, which is used to correct accumulative errors in the process of robot motion. In this paper, the shortcomings and limitations of traditional loop closure detection methods in visual SLAM system are analyzed, and a loop closure detection method fusing semantic information is proposed. Faster R-CNN convolution neural network model for image target detection is applied to a traditional loop closure detection method to realize the fusion of semantic similarity and feature point similarity based on Bag-of-Words (BoW) model, and to judge loops by using the fused similarity. The method is tested on the open data sets. The experimental results show that the proposed method has better detection effect in dynamic scenes, can improve the accuracy and recall rate of loop closure detection, and the system has stronger robustness.

[1]  T. Aaron Gulliver,et al.  A Faster RCNN-Based Pedestrian Detection System , 2016, 2016 IEEE 84th Vehicular Technology Conference (VTC-Fall).

[2]  Limin Wang,et al.  Bag of visual words and fusion methods for action recognition: Comprehensive study and good practice , 2014, Comput. Vis. Image Underst..

[3]  Ryan M. Eustice,et al.  Perception-driven navigation: Active visual SLAM for robotic area coverage , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Tao Zhang,et al.  Loop closure detection for visual SLAM systems using deep neural networks , 2015, 2015 34th Chinese Control Conference (CCC).

[6]  Patrick Rives,et al.  An Efficient Direct Approach to Visual SLAM , 2008, IEEE Transactions on Robotics.

[7]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Shilin Zhou,et al.  Convolutional neural network-based image representation for visual loop closure detection , 2015, 2015 IEEE International Conference on Information and Automation.

[9]  François Michaud,et al.  Online global loop closure detection for large-scale multi-session graph-based SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.