Deploying MAVs for autonomous navigation in dark underground mine environments

Abstract Operating Micro Aerial Vehicles (MAVs) in subterranean environments is becoming more and more relevant in the field of aerial robotics. Despite the large spectrum of technological advances in the field, flying in such challenging environments is still an ongoing quest that requires the combination of multiple sensor modalities like visual/thermal cameras as well as 3D and 2D lidars. Nevertheless, there exist cases in subterranean environments where the aim is to deploy fast and lightweight aerial robots for area reckoning purposes after an event (e.g. blasting in production areas). This work proposes a novel baseline approach for the navigation of resource constrained robots, introducing the aerial underground scout, with the main goal to rapidly explore unknown areas and provide a feedback to the operator. The main proposed framework focuses on the navigation, control and vision capabilities of the aerial platforms with low-cost sensor suites, contributing significantly towards real-life applications. The merit of the proposed control architecture is that it considers the flying platform as a floating object, composing a velocity controller on the x , y axes and altitude control to navigate along the tunnel. Two novel approaches make up the cornerstone of the proposed contributions for the task of navigation: (1) a vector geometry method based on 2D lidar, and (2) a Deep Learning (DL) method through a classification process based on an on-board image stream, where both methods correct the heading towards the center of the mine tunnel. Finally, the framework has been evaluated in multiple field trials in an underground mine in Sweden.

[1]  Kevin M. Brink,et al.  Distributed subterranean exploration and mapping with teams of UAVs , 2017, Defense + Security.

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[4]  Yoshua Bengio,et al.  Série Scientifique Scientific Series No Unbiased Estimator of the Variance of K-fold Cross-validation No Unbiased Estimator of the Variance of K-fold Cross-validation , 2022 .

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Sina Sharif Mansouri,et al.  Towards MAV Navigation in Underground Mine Using Deep Learning , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[7]  Tim McLain,et al.  ROSflight: A lightweight, inexpensive MAV research and development tool , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[8]  Kenneth Gade,et al.  The Seven Ways to Find Heading , 2016 .

[9]  Marc Pollefeys,et al.  An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  Kamal Youcef-Toumi,et al.  Ultra-Wideband Radar for Robust Inspection Drone in Underground Coal Mines , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Yves Le Traon,et al.  UAV degradation identification for pilot notification using machine learning techniques , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[12]  Teodor Tomic,et al.  Autonomous Vision‐based Micro Air Vehicle for Indoor and Outdoor Navigation , 2014, J. Field Robotics.

[13]  Vijay Kumar,et al.  Distributed Coverage and Exploration in Unknown Non-convex Environments , 2010, DARS.

[14]  En-Hui Zheng,et al.  Position and attitude tracking control for a quadrotor UAV. , 2014, ISA transactions.

[15]  Wolfram Burgard,et al.  Coordinated multi-robot exploration , 2005, IEEE Transactions on Robotics.

[16]  Jürgen Schmidhuber,et al.  A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots , 2016, IEEE Robotics and Automation Letters.

[17]  G Balamurugan,et al.  Survey on UAV navigation in GPS denied environments , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[18]  Christos Papachristos,et al.  Autonomous Navigation and Mapping in Underground Mines Using Aerial Robots , 2019, 2019 IEEE Aerospace Conference.

[19]  R. Siegwart,et al.  Towards autonomous mine inspection , 2014, Proceedings of the 2014 3rd International Conference on Applied Robotics for the Power Industry.

[20]  Nikolai Smolyanskiy,et al.  Toward low-flying autonomous MAV trail navigation using deep neural networks for environmental awareness , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Emil Fresk,et al.  Cooperative UAVs as a Tool for Aerial Inspection of the Aging Infrastructure , 2017, FSR.

[22]  Vijay Kumar,et al.  Autonomous Navigation and Mapping for Inspection of Penstocks and Tunnels With MAVs , 2017, IEEE Robotics and Automation Letters.

[23]  Vijay Kumar,et al.  Stochastic differential equation-based exploration algorithm for autonomous indoor 3D exploration with a micro-aerial vehicle , 2012, Int. J. Robotics Res..

[24]  Hyongsuk Kim,et al.  Accurate Natural Trail Detection Using a Combination of a Deep Neural Network and Dynamic Programming , 2018, Sensors.

[25]  Thomas Gustafsson,et al.  A Vision of Zero Entry Production Areas in Mines , 2015 .

[26]  Roland Siegwart,et al.  Model Predictive Control for Trajectory Tracking of Unmanned Aerial Vehicles Using Robot Operating System , 2017 .

[27]  Sina Sharif Mansouri,et al.  Towards Autonomous Surveying of Underground Mine Using MAVs , 2018, Advances in Service and Industrial Robotics.

[28]  Jaime Pulido Fentanes,et al.  A new method for efficient three-dimensional reconstruction of outdoor environments using mobile robots , 2011, J. Field Robotics.

[29]  Anthony Tzes,et al.  Switching model predictive attitude control for a quadrotor helicopter subject to atmospheric disturbances , 2011 .

[30]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Davide Scaramuzza,et al.  A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Yanning Zhang,et al.  Convolutional Neural Network-Based Robot Navigation Using Uncalibrated Spherical Images , 2017, Sensors.