A Novel Loop Closure Detection Method Using Line Features

Loop closure detection is a significant requirement for simultaneous localization and mapping (SLAM) to recognize revisited place. This paper presents a novel line-based loop closure detection method for vision-based SLAM that allows reliable loop closure detections, especial under structural environment. The performance of coping with perceptual aliasing conditions is more competitive than point based methods. The bag of words model is extended in this work which uses only line features. A variant of TF-IDF (term frequency & inverse document frequency) scoring scheme is proposed by adding a discrimination coefficient to improve the discrimination of image similarity scores, further to reinforce the similarity evaluation of two images. LBD (Line Band Descriptor) and binary LBD features are extracted to build visual vocabularies. Temporal consistency and spatial continuity checks enhance detection reliability. The performance of proposed scoring scheme was compared with original TF-IDF, results show that our proposed scheme has competitive discrimination ability. We also compared the query performance of our vocabularies with ORB-based, MSLD (mean standard-deviation line descriptor)-based, and PL (Point-and-Line)-based vocabularies, results indicate that our vocabularies obtain the highest successful retrieval rate. The performance of the whole loop closure detection algorithm was also evaluated in terms of precision, recall and efficiency, which were compared with ORB, MSLD, PL-based methods, and also with CNN-based method, results demonstrate that our method is superior to others with satisfactory precision and efficiency.

[1]  José Luis Gordillo,et al.  Visual EKF-SLAM from Heterogeneous Landmarks † , 2016, Sensors.

[2]  Reinhard Koch,et al.  An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency , 2013, J. Vis. Commun. Image Represent..

[3]  Stefano Soatto,et al.  A Simple Hierarchical Pooling Data Structure for Loop Closure , 2015, ECCV.

[4]  Antonios Gasteratos,et al.  Fast loop-closure detection using visual-word-vectors from image sequences , 2018, Int. J. Robotics Res..

[5]  Paul Newman,et al.  Appearance-only SLAM at large scale with FAB-MAP 2.0 , 2011, Int. J. Robotics Res..

[6]  Il Hong Suh,et al.  A vertical and floor line-based monocular SLAM system for corridor environments , 2012 .

[7]  Luis Miguel Bergasa,et al.  Fusion and binarization of CNN features for robust topological localization across seasons , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Yang Liu,et al.  Visual loop closure detection with a compact image descriptor , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Hua Wang,et al.  Sequence-based sparse optimization methods for long-term loop closure detection in visual SLAM , 2018, Autonomous Robots.

[10]  Luis Payá,et al.  Robust Visual Localization with Dynamic Uncertainty Management in Omnidirectional SLAM , 2017 .

[11]  Paul Newman,et al.  Detecting Loop Closure with Scene Sequences , 2007, International Journal of Computer Vision.

[12]  Zhixiong Li,et al.  Image Sequence Matching Using Both Holistic and Local Features for Loop Closure Detection , 2017, IEEE Access.

[13]  Winston Churchill,et al.  The New College Vision and Laser Data Set , 2009, Int. J. Robotics Res..

[14]  Niko Sünderhauf,et al.  On the performance of ConvNet features for place recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[16]  Dorian Gálvez-López,et al.  Robust Place Recognition With Stereo Sequences , 2012, IEEE Transactions on Robotics.

[17]  F. Michaud,et al.  Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation , 2013, IEEE Transactions on Robotics.

[18]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[19]  Jean-Arcady Meyer,et al.  Fast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words , 2008, IEEE Transactions on Robotics.

[20]  John J. Leonard,et al.  An Online Sparsity-Cognizant Loop-Closure Algorithm for Visual Navigation , 2014, Robotics: Science and Systems.

[21]  Teresa A. Vidal-Calleja,et al.  Impact of Landmark Parametrization on Monocular EKF-SLAM with Points and Lines , 2011, International Journal of Computer Vision.

[22]  Jun Miura,et al.  SeqSLAM++: View-based robot localization and navigation , 2019, Robotics Auton. Syst..

[23]  Dorian Gálvez-López,et al.  CI-Graph simultaneous localization and mapping for three-dimensional reconstruction of large and complex environments using a multicamera system , 2010, J. Field Robotics.

[24]  Il Hong Suh,et al.  Place recognition using straight lines for vision-based SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[25]  Javier Gonzalez-Jimenez,et al.  PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments , 2017, IEEE Transactions on Robotics.

[26]  Zhanyi Hu,et al.  MSLD: A robust descriptor for line matching , 2009, Pattern Recognit..

[27]  Kai Ma,et al.  Enhancing Place Recognition Using Joint Intensity - Depth Analysis and Synthetic Data , 2016, ECCV Workshops.

[28]  Tomohiro Shibata,et al.  High performance loop closure detection using bag of word pairs , 2016, Robotics Auton. Syst..

[29]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  Michael Milford,et al.  OpenSeqSLAM2.0: An Open Source Toolbox for Visual Place Recognition Under Changing Conditions , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Ji Zhao,et al.  PL-VIO: Tightly-Coupled Monocular Visual–Inertial Odometry Using Point and Line Features , 2018, Sensors.

[32]  Yan Su,et al.  Loop closure detection for visual SLAM systems using convolutional neural network , 2017, 2017 23rd International Conference on Automation and Computing (ICAC).

[33]  Paul Newman,et al.  Probabilistic Appearance Based Navigation and Loop Closing , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[34]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[36]  Antonios Gasteratos,et al.  Revisiting the Bag-of-Visual-Words model: A hierarchical localization architecture for mobile systems , 2019, Robotics Auton. Syst..

[37]  David J. Kriegman,et al.  Moving in stereo: Efficient structure and motion using lines , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[38]  Jindong Tan,et al.  Loop Closing Detection in RGB-D SLAM Combining Appearance and Geometric Constraints , 2015, Sensors.

[39]  Shilin Zhou,et al.  Convolutional neural network-based image representation for visual loop closure detection , 2015, 2015 IEEE International Conference on Information and Automation.

[40]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[41]  François Michaud,et al.  Online global loop closure detection for large-scale multi-session graph-based SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Avinash C. Kak,et al.  Building 3D visual maps of interior space with a new hierarchical sensor fusion architecture , 2013, Robotics Auton. Syst..

[43]  Simon Lacroix,et al.  Monocular-vision based SLAM using Line Segments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[44]  Francisco Angel Moreno,et al.  A collection of outdoor robotic datasets with centimeter-accuracy ground truth , 2009, Auton. Robots.

[45]  Wolfram Burgard,et al.  An efficient fastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[46]  Hong Zhang,et al.  Combining Multiple Image Descriptions for Loop Closure Detection , 2018, J. Intell. Robotic Syst..

[47]  Luis Payá,et al.  Trajectory estimation and optimization through loop closure detection, using omnidirectional imaging and global-appearance descriptors , 2018, Expert Syst. Appl..

[48]  Yasir Latif,et al.  Robust loop closing over time for pose graph SLAM , 2013, Int. J. Robotics Res..

[49]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[50]  Tao Zhang,et al.  Unsupervised learning to detect loops using deep neural networks for visual SLAM system , 2017, Auton. Robots.

[51]  Michael Milford,et al.  Place Recognition with ConvNet Landmarks: Viewpoint-Robust, Condition-Robust, Training-Free , 2015, Robotics: Science and Systems.

[52]  Roland Siegwart,et al.  The EuRoC micro aerial vehicle datasets , 2016, Int. J. Robotics Res..