Feature-based 3D SLAM

This doctoral thesis deals with an open subproblem of robot navigation, namely simultaneous localization and mapping (SLAM) in three-dimensional space. The goal is to develop a system which is capable of localizing a mobile robot in a reliable way and at the same time reconstruct its environment as a three-dimensional map. Besides enabling robot navigation in 3D, such a map could be of great importance for higher-level robotic tasks, like scene interpretation or manipulation as well as visualization purposes in general, which are required in surveying, architecture, urban search and rescue and others. The third dimension is challenging. Firstly, sensors providing three-dimensional data have to be found which suit the requirements of mobile robots and therefore have to be limited in size and power consumption. For this work, two sensors have been considered: the Swiss Ranger from CSEM (Swiss Center for Electronics and Microtechnology) and a custom-built range sensor based on a commercially available 2D laser scanner from SICK. Both are active sensors relying on measuring the time-of-flight of the emitted light. After calibration and error analysis it was concluded that the Swiss Ranger is less suited for localization and mapping than the rotating laser scanner due to its noisy data and limited field of view. It was therefore not further considered in the ensuing work. As a single 3D scan generated by the rotating laser scanner can be composed of many tens of thousands of data points and the robot takes dozens of scans during a mission, it is necessary to compress the raw data to visualize and process it efficiently. The method chosen in this work is to use a feature-based representation, which enables detailed and, at the same time, compact and informative environment reconstruction. The chosen features are planar segments, whose probabilistic representation and extraction are described, results of the SLAM algorithm are shown. With the aid of an Extended Kalman Filter (EKF) the pose of the robot and the location of the different planar segments – considering their uncertainty – can be estimated in an incremental way. The framework defined by the SPmodel (Symmetries and Perturbations Model) is used, allowing to represent and process various uncertain geometric models. The approach is validated through different experiments with a mobile robot in an office environment.

[1]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[2]  José A. Castellanos,et al.  Mobile Robot Localization and Map Building , 1999 .

[3]  Eduardo Mario Nebot,et al.  Optimization of the simultaneous localization and map-building algorithm for real-time implementation , 2001, IEEE Trans. Robotics Autom..

[4]  Rüdiger Dillmann,et al.  Sequential 3D-SLAM for mobile action planning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Suchendra M. Bhandarkar,et al.  Three-Dimensional Object Recognition from Range Images , 1992, Computer Science Workbench.

[6]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Juan D. Tardós Representing partial and uncertain sensorial information using the theory of symmetries , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[8]  Oliver Wulf,et al.  FAST 3 D SCANNING METHODS FOR LASER MEASUREMENT SYSTEMS , 2003 .

[9]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[10]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[11]  Günther Schmidt,et al.  Continuous localization of a mobile robot based on 3D-laser-range-data, predicted sensor images, and dead-reckoning , 1995, Robotics Auton. Syst..

[12]  Cang Ye,et al.  Characterization of a 2D laser scanner for mobile robot obstacle negotiation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  金谷 健一 Statistical optimization for geometric computation : theory and practice , 2005 .

[14]  Joachim Hertzberg,et al.  An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments , 2003, Robotics Auton. Syst..

[15]  Paul Newman,et al.  Outdoor SLAM using visual appearance and laser ranging , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  Antonio Reina,et al.  Characterization of a radial laser scanner for mobile robot navigation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Roland Siegwart,et al.  Feature-based multi-hypothesis localization and tracking using geometric constraints , 2003, Robotics Auton. Syst..

[18]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[19]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[20]  Ramakant Nevatia,et al.  Segmented descriptions of 3-D surfaces , 1987, IEEE Journal on Robotics and Automation.

[21]  Wolfram Burgard,et al.  An efficient fastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[22]  Wolfram Burgard,et al.  Using EM to Learn 3D Models of Indoor Environments with Mobile Robots , 2001, ICML.

[23]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[24]  Roland Siegwart,et al.  EKF-based 3D SLAM for structured environment reconstruction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[27]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[28]  Hilmar Ingensand,et al.  Calibration and improvements of the high-resolution range-imaging camera SwissRanger , 2005 .

[29]  Lindsay Kleeman,et al.  Uncertainty of Line Segments Extracted from Static SICK PLS Laser Scans , 2003 .

[30]  Raja Chatila,et al.  Stochastic multisensory data fusion for mobile robot location and environment modeling , 1989 .

[31]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[32]  Wolfram Burgard,et al.  Learning compact 3D models of indoor and outdoor environments with a mobile robot , 2003, Robotics Auton. Syst..

[33]  Sebastian Thrun,et al.  6D SLAM with an application in autonomous mine mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[34]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[35]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[36]  Michael Lehmann,et al.  An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger) , 2004, SPIE Optical Systems Design.

[37]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[38]  E. Kraft,et al.  A quaternion-based unscented Kalman filter for orientation tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[39]  Hans P. Moravec Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[40]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Horst Bunke,et al.  Fast segmentation of range images into planar regions by scan line grouping , 1994, Machine Vision and Applications.

[42]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[43]  Joachim Hertzberg,et al.  Fast Acquiring and Analysis of Three Dimensional Laser Range Data , 2001, VMV.

[44]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[45]  Hugh F. Durrant-Whyte,et al.  Mobile robot localization by tracking geometric beacons , 1991, IEEE Trans. Robotics Autom..

[46]  Wolfram Burgard,et al.  Experiences with an Interactive Museum Tour-Guide Robot , 1999, Artif. Intell..

[47]  Paulo Dias,et al.  3D Reconstruction of Real World Scenes Using a Low-Cost 3D Range Scanner , 2006, Comput. Aided Civ. Infrastructure Eng..

[48]  Rüdiger Dillmann,et al.  Aufbau und Modellierung des RoSi Scanners zur 3D-Tiefenbildakquisition , 2003, AMS.

[49]  Roland Siegwart,et al.  A Fast and Robust 3D Feature Extraction Algorithm for Structured Environment Reconstruction , 2003 .

[50]  Roland Siegwart,et al.  Hybrid simultaneous localization and map building: a natural integration of topological and metric , 2003, Robotics Auton. Syst..

[51]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  P.V.C. Hough,et al.  Machine Analysis of Bubble Chamber Pictures , 1959 .

[53]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[54]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[55]  Olivier D. Faugeras,et al.  Building, Registrating, and Fusing Noisy Visual Maps , 1988, Int. J. Robotics Res..

[56]  Roland Siegwart,et al.  Probabilistic plane fitting in 3D and an application to robotic mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[57]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[58]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[59]  Roland Siegwart,et al.  Environmental modeling with fingerprint sequences for topological global localization , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[60]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[61]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004 .

[62]  Patric Jensfelt,et al.  Active global localization for a mobile robot using multiple hypothesis tracking , 2001, IEEE Trans. Robotics Autom..

[63]  Eduardo Nebot,et al.  COMPRESSED FILTER FOR REAL TIME IMPLEMENTATION OF SIMULTANEOUS LOCALIZATION AND MAP BUILDING , 2000 .

[64]  Wolfram Burgard,et al.  Improving plane extraction from 3D data by fusing laser data and vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[65]  Alberto Elfes,et al.  Occupancy grids: a probabilistic framework for robot perception and navigation , 1989 .

[66]  William E. Lorensen,et al.  Decimation of triangle meshes , 1992, SIGGRAPH.

[67]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[68]  Hugh F. Durrant-Whyte,et al.  An Autonomous Guided Vehicle for Cargo Handling Applications , 1995, ISER.

[69]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[71]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[72]  K. Arras Feature-based robot navigation in known and unknown environments , 2003 .

[73]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[74]  Günther Schmidt,et al.  Continuous localization for long-range indoor navigation of mobile robots , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[75]  Melanie Remy,et al.  Wikipedia: The Free Encyclopedia200214Wikipedia: The Free Encyclopedia. 2001 – updated daily. Gratis http://www.wikipedia.com , 2002 .

[76]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[77]  Kia Ng,et al.  Automated reconstruction of 3D models from real environments , 1999 .

[78]  Naokazu Yokoya,et al.  Range Image Segmentation Based on Differential Geometry: A Hybrid Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[79]  J.G.M. Goncalves,et al.  High-level surface descriptions from composite range images , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[80]  Wolfram Burgard,et al.  Active Markov localization for mobile robots , 1998, Robotics Auton. Syst..

[81]  Wolfram Burgard,et al.  Particle Filters for Mobile Robot Localization , 2001, Sequential Monte Carlo Methods in Practice.

[82]  J. M. M. Montiel,et al.  The SPmap: a probabilistic framework for simultaneous localization and map building , 1999, IEEE Trans. Robotics Autom..

[83]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[84]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[86]  Wolfram Burgard,et al.  Recovering Particle Diversity in a Rao-Blackwellized Particle Filter for SLAM After Actively Closing Loops , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[87]  Wolfram Burgard,et al.  A Real-time Algorithm for Acquiring Multi-Planar Volumetric Models with Mobile Robots , 2001, ISRR.

[88]  Stefan B. Williams,et al.  Three-Dimensional Robotic Mapping , 2003 .

[89]  Randall Smith,et al.  Estimating Uncertain Spatial Relationships in Robotics , 1987, Autonomous Robot Vehicles.

[90]  Favio R. Masson,et al.  Simultaneous localization and map building using natural features and absolute information , 2002, Robotics Auton. Syst..