Online LiDAR-SLAM for Legged Robots with Robust Registration and Deep-Learned Loop Closure

In this paper, we present a 3D factor-graph LiDAR-SLAM system which incorporates a state-of-the-art deeply learned feature-based loop closure detector to enable a legged robot to localize and map in industrial environments. Point clouds are accumulated using an inertial-kinematic state estimator before being aligned using ICP registration. To close loops we use a loop proposal mechanism which matches individual segments between clouds. We trained a descriptor offline to match these segments. The efficiency of our method comes from carefully designing the network architecture to minimize the number of parameters such that this deep learning method can be deployed in real-time using only the CPU of a legged robot, a major contribution of this work. The set of odometry and loop closure factors are updated using pose graph optimization. Finally we present an efficient risk alignment prediction method which verifies the reliability of the registrations. Experimental results at an industrial facility demonstrated the robustness and flexibility of our system, including autonomous following paths derived from the SLAM map.

[1]  Ji Zhang,et al.  On degeneracy of optimization-based state estimation problems , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Renaud Dubé,et al.  SegMatch: Segment based place recognition in 3D point clouds , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Berthold Bäuml,et al.  Graph SLAM with signed distance function maps on a humanoid robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[6]  Marilena Vendittelli,et al.  Vision-based Odometric Localization for humanoids using a kinematic EKF , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[7]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[8]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[9]  F. Dellaert Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .

[10]  Olivier Stasse,et al.  3D grid and particle based SLAM for a humanoid robot , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[11]  Paul Newman,et al.  Adversarial Training for Adverse Conditions: Robust Metric Localisation Using Appearance Transfer , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[13]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Simona Nobili,et al.  Direct visual SLAM fusing proprioception for a humanoid robot , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Wei Wu,et al.  PointCNN: convolution on Χ -transformed points , 2018, NIPS 2018.

[16]  Olivier Stasse,et al.  Real-time 3D SLAM for Humanoid Robot considering Pattern Generator Information , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  François Pomerleau,et al.  Applied registration for robotics: Methodology and tools for ICP-like algorithms , 2013 .

[18]  SungHwan Ahn,et al.  On-board odometry estimation for 3D vision-based SLAM of humanoid robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Cyrill Stachniss,et al.  Efficient Surfel-Based SLAM using 3D Laser Range Data in Urban Environments , 2018, Robotics: Science and Systems.

[21]  Simona Nobili,et al.  Heterogeneous Sensor Fusion for Accurate State Estimation of Dynamic Legged Robots , 2017, Robotics: Science and Systems.

[22]  Peter Fankhauser,et al.  ANYmal - a highly mobile and dynamic quadrupedal robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[24]  Mike Stilman,et al.  State Estimation for Legged Robots - Consistent Fusion of Leg Kinematics and IMU , 2012, RSS 2012.

[25]  Adrian Penate-Sanchez,et al.  Learning to See the Wood for the Trees: Deep Laser Localization in Urban and Natural Environments on a CPU , 2019, IEEE Robotics and Automation Letters.

[26]  Sangbae Kim,et al.  Online Planning for Autonomous Running Jumps Over Obstacles in High-Speed Quadrupeds , 2015, Robotics: Science and Systems.

[27]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[28]  Jean-Emmanuel Deschaud,et al.  IMLS-SLAM: Scan-to-Model Matching Based on 3D Data , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Peter Fankhauser,et al.  ANYmal - a highly mobile and dynamic quadrupedal robot , 2016, IROS 2016.

[30]  Renaud Dubé,et al.  An online multi-robot SLAM system for 3D LiDARs , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Simona Nobili,et al.  Overlap-based ICP tuning for robust localization of a humanoid robot , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Stefan Leutenegger,et al.  ElasticFusion: Dense SLAM Without A Pose Graph , 2015, Robotics: Science and Systems.

[33]  Wei Wu,et al.  PointCNN: Convolution On X-Transformed Points , 2018, NeurIPS.

[34]  Roland Siegwart,et al.  State Estimation for Legged Robots - Consistent Fusion of Leg Kinematics and IMU , 2012, Robotics: Science and Systems.

[35]  Simona Nobili,et al.  Predicting Alignment Risk to Prevent Localization Failure , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Maren Bennewitz,et al.  Humanoid robot localization in complex indoor environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[38]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[39]  David R. Kincaid,et al.  Numerical mathematics and computing , 1980 .

[40]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[41]  Hannes Sommer,et al.  The Two-State Implicit Filter Recursive Estimation for Mobile Robots , 2018, IEEE Robotics and Automation Letters.