Semi-Supervised SLAM: Leveraging Low-Cost Sensors on Underground Autonomous Vehicles for Position Tracking

This work presents Semi-Supervised SLAM - a method for developing a map suitable for coarse localization within an underground environment with minimal human intervention, with system characteristics driven by real-world requirements of major mining companies. This work leverages existing information common within a mining environment - namely a surveyed mine map - which is used to sparsely ground map locations within the mine environment, increasing map accuracy and allowing localization within a global frame. Map creation utilizes a low cost camera sensor and minimal user information to produce a map which can be used for single camera localization within a mining environment. We evaluate the localization capabilities of the proposed approach in depth by performing data collection on operational underground mining vehicles within an active underground mine and by simulating occlusions common to the environment such as dust and water. The proposed system is capable of producing maps which have an average localization error 2.5 times smaller than the next best performing method ORB-SLAM2, comparable localization performance to a state-of-the-art deep learning approach (which is not a feasible solution due to both compute and training requirements) and is robust to simulated environmental obscurants.

[1]  Brett Browning,et al.  Visual place recognition using HMM sequence matching , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Nicholas Roy,et al.  Visual Route Recognition with a Handful of Bits , 2013 .

[5]  Janet Wiles,et al.  OpenRatSLAM: an open source brain-based SLAM system , 2013, Autonomous Robots.

[6]  Lina María Paz,et al.  Large-Scale 6-DOF SLAM With Stereo-in-Hand , 2008, IEEE Transactions on Robotics.

[7]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[8]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[9]  Michael Milford,et al.  Online place recognition calibration for out-of-the-box SLAM , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Michael Milford,et al.  Autonomous Multisensor Calibration and Closed‐loop Fusion for SLAM , 2014, J. Field Robotics.

[11]  Niko Sünderhauf,et al.  On the performance of ConvNet features for place recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Winston Churchill,et al.  Experience-based navigation for long-term localisation , 2013, Int. J. Robotics Res..

[13]  Tom Duckett,et al.  A Minimalistic Approach to Appearance-Based Visual SLAM , 2008, IEEE Transactions on Robotics.

[14]  Joshua A. Marshall,et al.  A landmark‐bounded method for large‐scale underground mine mapping , 2012, J. Field Robotics.

[15]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[16]  Denis Kent Digital Networks and Applications in Underground Coal Mines , 2011 .

[17]  Mohammad Ali Moridi,et al.  Development of underground mine monitoring and communication system integrated ZigBee and GIS , 2015, International Journal of Mining Science and Technology.

[18]  Michael Milford,et al.  Brain-inspired sensor fusion for navigating robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Mark Hedley,et al.  WASP: A System and Algorithms for Accurate Radio Localization Using Low-Cost Hardware , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[21]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[22]  Peter I. Corke,et al.  Automation of an underground mining vehicle using reactive navigation and opportunistic localization , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[23]  Aram Kawewong,et al.  Online and Incremental Appearance-based SLAM in Highly Dynamic Environments , 2011, Int. J. Robotics Res..

[24]  Paul Newman,et al.  From dusk till dawn: Localisation at night using artificial light sources , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Christof Röhrig,et al.  Localization of Sensor Nodes in a Wireless Sensor Network Using the nanoLOC TRX Transceiver , 2009, VTC Spring 2009 - IEEE 69th Vehicular Technology Conference.

[27]  Edwin Olson,et al.  Exploration and mapping with autonomous robot teams , 2013, CACM.

[28]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.