Three-Dimensional Mapping with Augmented Navigation Cost through Deep Learning

This work addresses the problem of mapping terrain features based on inertial and LiDAR measurements in order to estimate the navigation cost for an autonomous ground robot. Unlike most indoor applications, where surfaces are usually human-made, flat, and structured, external environments may be unpredictable as to the types and conditions of the travel surfaces, such as traction characteristics and inclination. Attaining full autonomy in outdoor environments requires a mobile ground robot to perform the fundamental localization and mapping tasks in unfamiliar environments, but with the added challenge of unknown terrain conditions. Autonomous motion in uneven terrain has been widely explored by the research community focusing on one or more of the several factors involved aiming at both safety and efficient displacement. A fuller representation of the environment is fundamental to increase confidence and to reduce navigation costs. To this end we propose a methodology composed of five main steps: (i) speedinvariant inertial transformation; (ii) roughness level classification; (iii) navigation cost estimation; (iv) sensor fusion through Deep Learning; and (v) estimation of navigation costs for untraveled regions. To validate the methodology, we carried out experiments using ground robots in different outdoor environments with different terrain characteristics. Results show that the terrain maps thus obtained are a faithful representation of outdoor environments allowing for accurate and reliable path planning.

[1]  Andreas Zell,et al.  Robust Visual Terrain Classification with Recurrent Neural Networks , 2015, ESANN.

[2]  Zhiqiang Cao,et al.  A terrain description method for traversability analysis based on elevation grid map , 2018 .

[3]  Fabio Tozeto Ramos,et al.  Bayesian optimisation for active perception and smooth navigation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Larry H. Matthies,et al.  Terrain Adaptive Navigation for planetary rovers , 2009, J. Field Robotics.

[5]  Meng Chen,et al.  An autonomous exploration algorithm using environment-robot interacted traversability analysis , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Kiho Kwak,et al.  Probabilistic traversability map generation using 3D-LIDAR and camera , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Mario F. M. Campos,et al.  Augmented Vector Field Navigation Cost Mapping using Inertial Sensors , 2019, 2019 19th International Conference on Advanced Robotics (ICAR).

[9]  Cang Ye,et al.  T-transformation: traversability analysis for navigation on rugged terrain , 2004, SPIE Defense + Commercial Sensing.

[10]  Andreas Zell,et al.  Recurrent Neural Networks for fast and robust vibration-based ground classification on mobile robots , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Zerui Li,et al.  Comparative Study of Different Methods in Vibration-Based Terrain Classification for Wheeled Robots with Shock Absorbers , 2019, Sensors.

[12]  Hailin Ren,et al.  Neural Network Based Heterogeneous Sensor Fusion for Robot Motion Planning , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Cyrill Stachniss,et al.  Actively Improving Robot Navigation On Different Terrains Using Gaussian Process Mixture Models , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[14]  Alberto Elfes,et al.  Real-time autonomous ground vehicle navigation in heterogeneous environments using a 3D LiDAR , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[16]  Shifeng Wang,et al.  Road-Terrain Classification for Land Vehicles: Employing an Acceleration-Based Approach , 2017, IEEE Vehicular Technology Magazine.

[17]  Prithviraj Dasgupta,et al.  Ensemble Learning With Weak Classifiers for Fast and Reliable Unknown Terrain Classification Using Mobile Robots , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Wolfram Burgard,et al.  Traversability analysis for mobile robots in outdoor environments: A semi-supervised learning approach based on 3D-lidar data , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Emmanuel G. Collins,et al.  Frequency response method for terrain classification in autonomous ground vehicles , 2008, Auton. Robots.

[20]  Saeed Ebrahimi,et al.  A New Contact Angle Detection Method for Dynamics Estimation of a UGV Subject to Slipping in Rough-Terrain , 2019, J. Intell. Robotic Syst..

[21]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Pinhas Ben-Tzvi,et al.  Physics Based Path Planning for Autonomous Tracked Vehicle in Challenging Terrain , 2018, Journal of Intelligent & Robotic Systems.

[23]  D. N. Kim,et al.  Fast Fourier Transform - Algorithms and Applications , 2010 .

[24]  Yang Gao,et al.  A survey on terrain assessment techniques for autonomous operation of planetary robots , 2010 .

[25]  Masahiro Ono,et al.  Risk-aware planetary rover operation: Autonomous terrain classification and path planning , 2015, 2015 IEEE Aerospace Conference.

[26]  M A Amiri Atashgah,et al.  A simulation environment for path and image generation in an aerial single-camera vision system , 2011 .

[27]  Javier Ruiz-del-Solar,et al.  A Kalman-filtering-based Approach for Improving Terrain Mapping in off-road Autonomous Vehicles , 2015, J. Intell. Robotic Syst..

[28]  Atsushi Yamashita,et al.  Fuzzy based traversability analysis for a mobile robot on rough terrain , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Guilherme A. S. Pereira,et al.  Robot Navigation in Multi-terrain Outdoor Environments , 2009, Int. J. Robotics Res..

[30]  Michael Bosse,et al.  Driving on Point Clouds: Motion Planning, Trajectory Optimization, and Terrain Assessment in Generic Nonplanar Environments , 2017, J. Field Robotics.

[31]  Jorge L. Martinez,et al.  Supervised Learning of Natural-Terrain Traversability with Synthetic 3D Laser Scans , 2020 .

[32]  Marion Jaud,et al.  Towards LIDAR-RADAR based terrain mapping , 2015, 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO).

[33]  Manuela Chessa,et al.  Mobility Map Computations for Autonomous Navigation using an RGBD Sensor , 2016, ArXiv.

[34]  Mario F. M. Campos,et al.  Speed-invariant terrain roughness classification and control based on inertial sensors , 2017, 2017 Latin American Robotics Symposium (LARS) and 2017 Brazilian Symposium on Robotics (SBR).

[35]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[36]  Kevin M. Lynch,et al.  Modern Robotics: Mechanics, Planning, and Control , 2017 .