Three‐dimensional mapping with time‐of‐flight cameras

This article investigates the use of time-of-flight (ToF) cameras in mapping tasks for autonomous mobile robots, in particular in simultaneous localization and mapping May et al.: 3D Mapping with Time-of-Flight Cameras • 935 (SLAM) tasks. Although ToF cameras are in principle an attractive type of sensor for three-dimensional (3D) mapping owing to their high rate of frames of 3D data, two features make them difficult as mapping sensors, namely, their restricted field of view and influences on the quality of range measurements by high dynamics in object reflectivity; in addition, currently available models suffer from poor data quality in a number of aspects. The paper first summarizes calibration and filtering approaches for improving the accuracy , precision, and robustness of ToF cameras independent of their intended usage. Then, several ego motion estimation approaches are applied or adapted, respectively, in order to provide a performance benchmark for registering ToF camera data. As a part of this, an extension to the iterative closest point algorithm has been developed that increases the robustness under restricted field of view and under larger displacements. Using an indoor environment, the paper provides results from SLAM experiments using these approaches in comparison. It turns out that the application of ToF cameras is feasible to SLAM tasks, although this type of sensor has a complex error characteristic. C

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Luc Van Gool,et al.  Matching of 3-D curves using semi-differential invariants , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Wolfgang Straßer,et al.  On-the-fly scene acquisition with a handy multi-sensor system , 2008, Int. J. Intell. Syst. Technol. Appl..

[4]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[5]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[6]  Joachim Hertzberg,et al.  6D SLAM—3D mapping outdoor environments , 2007, J. Field Robotics.

[7]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004 .

[8]  Stefan May,et al.  3D Cameras: 3D Computer Vision of wide Scope , 2007 .

[9]  Dirk Holz,et al.  Continuous 3D sensing for navigation and SLAM in cluttered and dynamic environments , 2008, 2008 11th International Conference on Information Fusion.

[10]  Heinz Hügli,et al.  Real-time scattering compensation for time-of-flight camera , 2007, ICVS 2007.

[11]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[13]  A. Sappa,et al.  Range Image Registration by using an Edge-Based Representation , 2001 .

[14]  M. W. Kadous,et al.  On building 3D maps using a Range Camera: Applications to Rescue Robotics , 2006 .

[15]  Bing Liu,et al.  A Comprehensive System for 3D Modeling from Range Images Acquired from a 3D ToF Sensor , 2007, ICVS 2007.

[16]  Andrea Fusiello,et al.  Model Acquisition by Registration of Multiple Acoustic Range Views , 2002, ECCV.

[17]  Kazunori Ohno,et al.  Real-Time Robot Trajectory Estimation and 3D Map Construction using 3D Camera , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Stefan May,et al.  3D Mapping with Time-of-Flight Cameras , 2009 .

[19]  Paul Newman,et al.  Using laser range data for 3D SLAM in outdoor environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[20]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Andreas Nüchter,et al.  3D Robotic Mapping - The Simultaneous Localization and Mapping Problem with Six Degrees of Freedom , 2009, Springer Tracts in Advanced Robotics.

[22]  Andreas Birk,et al.  Sub-pixel depth accuracy with a time of flight sensor using multimodal Gaussian analysis , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Q. M. Jonathan Wu,et al.  Visual Tracking Using Color Cameras and Time-of-Flight Range Imaging Sensors , 2008, J. Multim..

[24]  Robert B. Fisher,et al.  A Comparison of Four Algorithms for Estimating 3-D Rigid Transformations , 1995, BMVC.

[25]  Heinrich Niemann,et al.  A refined ICP algorithm for robust 3-D correspondence estimation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[26]  C. Q. Little,et al.  Registration of range data using a hybrid simulated annealing and iterative closest point algorithm , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[27]  Luc Van Gool,et al.  European conference on computer vision (ECCV) , 2006, eccv 2006.

[28]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[29]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[30]  Jan-Michael Frahm,et al.  Joint Feature Tracking and Radiometric Calibration from Auto-Exposure Video , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  Ezio Malis.  An efficient unified approach to direct visual tracking of rigid and deformable surfaces , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Reinhard Koch,et al.  Pose Estimation and Map Building with a PMD-Camera for Robot Navigation , 2007 .

[33]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[34]  Stefan May,et al.  Calibration and Registration for Precise Surface Reconstruction with TOF Cameras , 2007 .

[35]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[36]  Geraldo F. Silveira,et al.  Real-time Visual Tracking under Arbitrary Illumination Changes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[39]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[40]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[41]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .