What localizes beneath: A metric multisensor localization and mapping system for autonomous underground mining vehicles

Robustly and accurately localizing vehicles in underground mines is particularly challenging due to the unavailability of GPS, variable and often poor lighting conditions, visual aliasing in long tunnels, and airborne dust and water. In this paper, we present a novel, infrastructure-less, multisensor localization method for robust autonomous operation within underground mines. The proposed method integrates with existing mine site commissioning and operation procedures and includes both an offline map-building process and an online localization algorithm. The approach combines the strengths of visual-based place recognition, LIDAR-based localization, and odometry in a particle filter fusion process. We provide an extensive experimental validation using new large data sets acquired in two operational Australian underground hard-rock mines (including a 600m-deep multilevel mine with approximately 33 km of mapping data and 7 km of vehicle localization) by actual mining vehicles during production operations. We demonstrate a significant increase in localization accuracy over prior state-of-the-art SLAM research systems and real-time operation, with processing times in the order of 10 Hz. We present results showing a mean error of 0.68 m from the Queensland Mine data set and 1.32 m from the New South Wales Mine data set and at least 86% reduction in error compared with prior state of the art. We also analyze the impact of the particle filter parameters with respect to localization accuracy. Together this study represents a new approach to positioning systems for currently deployed autonomous vehicles within underground mine environments.

[1]  Bi Lin,et al.  Robust GICP-Based 3D LiDAR SLAM for Underground Mining Environment , 2019, Sensors.

[2]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[3]  Wolfram Burgard,et al.  OctoMap : A Probabilistic , Flexible , and Compact 3 D Map Representation for Robotic Systems , 2010 .

[4]  Jana Kosecka,et al.  Experiments in place recognition using gist panoramas , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Vladimir Polotski,et al.  Autonomous system for navigation and surveying in underground mines , 2007, J. Field Robotics.

[6]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[7]  Illah R. Nourbakhsh,et al.  Appearance-based place recognition for topological localization , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  Wolfram Burgard,et al.  A Probabilistic Approach to Concurrent Mapping and Localization for Mobile Robots , 1998, Auton. Robots.

[9]  Thierry Peynot,et al.  TIMTAM: Tunnel-Image Texturally Accorded Mosaic for Location Refinement of Underground Vehicles With a Single Camera , 2019, IEEE Robotics and Automation Letters.

[10]  Randall Smith,et al.  Estimating Uncertain Spatial Relationships in Robotics , 1987, Autonomous Robot Vehicles.

[11]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[12]  Hugh F. Durrant-Whyte,et al.  Map-building and map-based localization in an underground-mine by statistical pattern matching , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[13]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Daniel F. Huber,et al.  Automatic Three-dimensional Underground Mine Mapping , 2006, Int. J. Robotics Res..

[15]  Joshua A. Marshall,et al.  A landmark‐bounded method for large‐scale underground mine mapping , 2012, J. Field Robotics.

[16]  Gordon Wyeth,et al.  RatSLAM: a hippocampal model for simultaneous localization and mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[17]  Michael Milford.  Visual Route Recognition with a Handful of Bits , 2012, Robotics: Science and Systems.

[18]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[19]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[20]  Christoforos Kanellakis,et al.  Evaluation of visual localization systems in underground mining , 2016, 2016 24th Mediterranean Conference on Control and Automation (MED).

[21]  Boqiang Shi,et al.  Automatic guidance of underground mining vehicles using laser sensors , 2011 .

[22]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[23]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Michael Milford,et al.  Brain-inspired sensor fusion for navigating robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[25]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[26]  Gamini Dissanayake,et al.  Map Building and Terrain-Aided Localisation in an Underground Mine , 1998 .

[27]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[29]  Christof Röhrig,et al.  Localization of Sensor Nodes in a Wireless Sensor Network Using the nanoLOC TRX Transceiver , 2009, VTC Spring 2009 - IEEE 69th Vehicular Technology Conference.

[30]  Mohammad Ali Moridi,et al.  Development of underground mine monitoring and communication system integrated ZigBee and GIS , 2015, International Journal of Mining Science and Technology.

[31]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[32]  Paul Newman,et al.  From dusk till dawn: Localisation at night using artificial light sources , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[33]  William Whittaker,et al.  Conditional particle filters for simultaneous mobile robot localization and people-tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[34]  Andrea Censi,et al.  An ICP variant using a point-to-line metric , 2008, 2008 IEEE International Conference on Robotics and Automation.

[35]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[36]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[37]  Dongwook Kim,et al.  Lane map building and localization for automated driving using 2D laser rangefinder , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[38]  Mark Hedley,et al.  WASP: A System and Algorithms for Accurate Radio Localization Using Low-Cost Hardware , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[39]  Niko Sünderhauf,et al.  Appearance change prediction for long-term navigation across seasons , 2013, 2013 European Conference on Mobile Robots.

[40]  Peter I. Corke,et al.  Automation of an underground mining vehicle using reactive navigation and opportunistic localization , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[41]  Eric Moulines,et al.  Comparison of resampling schemes for particle filtering , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[42]  Michael Milford,et al.  Semi-Supervised SLAM: Leveraging Low-Cost Sensors on Underground Autonomous Vehicles for Position Tracking , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[43]  Sebastian Thrun,et al.  6D SLAM with an application in autonomous mine mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.