Fusion of Building Information and Range Imaging for Autonomous Location Estimation in Indoor Environments

We present a novel approach for autonomous location estimation and navigation in indoor environments using range images and prior scene knowledge from a GIS database (CityGML). What makes this task challenging is the arbitrary relative spatial relation between GIS and Time-of-Flight (ToF) range camera further complicated by a markerless configuration. We propose to estimate the camera's pose solely based on matching of GIS objects and their detected location in image sequences. We develop a coarse-to-fine matching strategy that is able to match point clouds without any initial parameters. Experiments with a state-of-the-art ToF point cloud show that our proposed method delivers an absolute camera position with decimeter accuracy, which is sufficient for many real-world applications (e.g., collision avoidance).

[1]  Thierry Oggier,et al.  CCD / CMOS Lock-In Pixel for Range Imaging : Challenges , Limitations and State-ofthe-Art , 2005 .

[2]  Yang Gao,et al.  Indoor Navigation with iPhone/iPad: Floor Plan Based Monocular Vision Navigation , 2012 .

[3]  Joachim Hertzberg,et al.  Three‐dimensional mapping with time‐of‐flight cameras , 2009, J. Field Robotics.

[4]  Andreas Donaubauer,et al.  Real-time indoor positioning using range imaging sensors , 2010, Photonics Europe.

[5]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[6]  David J. Thuente,et al.  Line search algorithms with guaranteed sufficient decrease , 1994, TOMS.

[7]  H. Aanaes,et al.  Environmental Effects on Measurement Uncertainties of Time-of-Flight Cameras , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[8]  R. Mautz.  Indoor Positioning Technologies , 2012 .

[9]  Jake K. Aggarwal,et al.  Model-based object recognition in dense-range images—a review , 1993, CSUR.

[10]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  T. H. Kolbe,et al.  OpenGIS City Geography Markup Language (CityGML) Encoding Standard, Version 1.0.0 , 2008 .

[12]  Jens T. Thielemann,et al.  Modelling and compensating measurement errors caused by scattering in time-of-flight cameras , 2008, Optical Engineering + Applications.

[13]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Andreas Kolb,et al.  Compensation of Motion Artifacts for Time-of-Flight Cameras , 2009, Dyn3D.

[16]  Federico Tombari,et al.  Object Recognition in 3D Scenes with Occlusions and Clutter by Hough Voting , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[17]  Wilfried KAREL,et al.  IN SITU DETERMINATION OF RANGE CAMERA QUALITY PARAMETERS BY SEGMENTATION , 2007 .

[18]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[19]  Jochen Frey,et al.  Robust 3 D Measurement with PMD Sensors , 2005 .

[20]  Martin Magnusson,et al.  The three-dimensional normal-distributions transform : an efficient representation for registration, surface analysis, and loop detection , 2009 .

[21]  H. Ingensand,et al.  High-precision investigations of the fast range imaging camera SwissRanger , 2007, SPIE Optics East.

[22]  Hilmar Ingensand,et al.  Calibration and improvements of the high-resolution range-imaging camera SwissRanger , 2005 .

[23]  Frédéric Bosché,et al.  Automated retrieval of 3D CAD model objects in construction range images , 2008 .

[24]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[25]  Sven Behnke,et al.  Indoor Positioning and Navigation Using Time-Of-Flight Cameras , 2013 .

[26]  M. W. Kadous,et al.  On building 3D maps using a Range Camera: Applications to Rescue Robotics , 2006 .

[27]  Stefan May,et al.  Calibration and registration for precise surface reconstruction with Time-Of-Flight cameras , 2008, Int. J. Intell. Syst. Technol. Appl..

[28]  Heinz Hügli,et al.  Optimized scattering compensation for time-of-flight camera , 2007, SPIE Optics East.

[29]  Chadly Marouane,et al.  Indoor positioning using smartphone camera , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[30]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Abdelmoumen Norrdine,et al.  Building information systems based on precise indoor positioning , 2011, J. Locat. Based Serv..

[32]  Reinhard Koch,et al.  Pose estimation and map building with a Time-Of-Flight-camera for robot navigation , 2008, Int. J. Intell. Syst. Technol. Appl..

[33]  Thomas H. Kolbe,et al.  Conceptual Requirements for the Automatic Reconstruction of Building Information Models from Uninterpreted 3D Models , 2009 .