Indoor Localization Algorithms for an Ambulatory Human Operated 3D Mobile Mapping System

Indoor localization and mapping is an important problem with many applications such as emergency response, architectural modeling, and historical preservation. In this paper, we develop an automatic, off-line pipeline for metrically accurate, GPS-denied, indoor 3D mobile mapping using a human-mounted backpack system consisting of a variety of sensors. There are three novel contributions in our proposed mapping approach. First, we present an algorithm which automatically detects loop closure constraints from an occupancy grid map. In doing so, we ensure that constraints are detected only in locations that are well conditioned for scan matching. Secondly, we address the problem of scan matching with poor initial condition by presenting an outlier-resistant, genetic scan matching algorithm that accurately matches scans despite a poor initial condition. Third, we present two metrics based on the amount and complexity of overlapping geometry in order to vet the estimated loop closure constraints. By doing so, we automatically prevent erroneous loop closures from degrading the accuracy of the reconstructed trajectory. The proposed algorithms are experimentally verified using both controlled and real-world data. The end-to-end system performance is evaluated using 100 surveyed control points in an office environment and obtains a mean accuracy of 10 cm. Experimental results are also shown on three additional datasets from real world environments including a 1500 meter trajectory in a warehouse sized retail shopping center.

[1]  Vijay Kumar,et al.  Autonomous indoor 3D exploration with a micro-aerial vehicle , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Michael Bosse,et al.  Watertight surface reconstruction of caves from 3D laser data , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[4]  Andrea Censi,et al.  An ICP variant using a point-to-line metric , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Joel A. Hesch,et al.  A Laser-Aided Inertial Navigation System (L-INS) for human localization in unknown indoor environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Andrew W. Fitzgibbon,et al.  Robust Registration of 2D and 3D Point Sets , 2003, BMVC.

[7]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  K. Moffett,et al.  Remote Sens , 2015 .

[9]  Avideh Zakhor,et al.  Indoor Localization Algorithms for a Human-Operated Backpack System , 2010 .

[10]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[11]  Patrick Robertson,et al.  FootSLAM: Pedestrian Simultaneous Localization and Mapping Without Exteroceptive Sensors—Hitchhiking on Human Perception and Cognition , 2012, Proceedings of the IEEE.

[12]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[13]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[14]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[15]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[16]  Javier González,et al.  Mobile robot motion estimation by 2D scan matching with genetic and iterative closest point algorithms , 2006, J. Field Robotics.

[17]  C.K. Toth,et al.  Multi-sensor personal navigator supported by adaptive knowledge based system: Performance assessment , 2008, 2008 IEEE/ION Position, Location and Navigation Symposium.

[18]  Avideh Zakhor,et al.  Indoor localization and visualization using a human-operated backpack system , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[19]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Wolfram Burgard,et al.  Improving Grid-based SLAM with Rao-Blackwellized Particle Filters by Adaptive Proposals and Selective Resampling , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[21]  Rongxing Li,et al.  Mobile Mapping: An Emerging Technology for Spatial Data Acquisition , 1997 .

[22]  Karl Granström,et al.  Learning to detect loop closure from range data , 2009, 2009 IEEE International Conference on Robotics and Automation.

[23]  Avideh Zakhor,et al.  Texture mapping 3 D planar models of indoor environments with noisy camera poses , 2013 .

[24]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[25]  N. El-Sheimy,et al.  LAND-BASED MOBILE MAPPING SYSTEMS , 2002 .

[26]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[27]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[28]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[29]  Michael Bosse,et al.  Map Matching and Data Association for Large-Scale Two-dimensional Laser Scan-based SLAM , 2008, Int. J. Robotics Res..

[30]  Francesca Odone,et al.  Histogram intersection kernel for image classification , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  Enzo Mumolo,et al.  Robust and Accurate Genetic Scan Matching Algorithm for Robotic Navigation , 2011, ICIRA.

[32]  Michael Bosse,et al.  Line-based extrinsic calibration of range and image sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[33]  Avideh Zakhor,et al.  Automatic loop closure detection using multiple cameras for 3D indoor localization , 2012, Electronic Imaging.

[34]  Ran Liu,et al.  Outlier Robust ICP for Minimizing Fractional RMSD , 2006, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[35]  Avideh Zakhor,et al.  Watertight Planar Surface Meshing of Indoor Point-Clouds with Voxel Carving , 2013, 2013 International Conference on 3D Vision.

[36]  In-So Kweon,et al.  Capturing Village-level Heritages with a Hand-held Camera-Laser Fusion Sensor , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[37]  Michael Bosse,et al.  Keypoint design and evaluation for place recognition in 2D lidar maps , 2009, Robotics Auton. Syst..

[38]  Albert S. Huang,et al.  Estimation, planning, and mapping for autonomous flight using an RGB-D camera in GPS-denied environments , 2012, Int. J. Robotics Res..

[39]  Aemal J. Khattak,et al.  Evaluation of Mobile Mapping Systems for Roadway Data Collection , 2000 .

[40]  Wolfram Burgard,et al.  Nonlinear Constraint Network Optimization for Efficient Map Learning , 2009, IEEE Transactions on Intelligent Transportation Systems.

[41]  Michael Bosse,et al.  Zebedee: Design of a Spring-Mounted 3-D Range Sensor with Application to Mobile Mapping , 2012, IEEE Transactions on Robotics.

[42]  Stewart He,et al.  Texture mapping 3D models of indoor environments with noisy camera poses , 2013, Electronic Imaging.

[43]  John J. Leonard,et al.  Sensor fusion for flexible human-portable building-scale mapping , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..