Visual SLAM for autonomous ground vehicles

Simultaneous Localization and Mapping (SLAM) and Visual SLAM (V-SLAM) in particular have been an active area of research lately. In V-SLAM the main focus is most often laid on the localization part of the problem allowing for a drift free motion estimate. To this end, a sparse set of landmarks is tracked and their position is estimated. However, this set of landmarks (rendering the map) is often too sparse for tasks in autonomous driving such as navigation, path planning, obstacle avoidance etc. Some methods keep the raw measurements for past robot poses to address the sparsity problem often resulting in a pose only SLAM akin to laser scanner SLAM. For the stereo case, this is however impractical due to the high noise of stereo reconstructed point clouds. In this paper we propose a dense stereo V-SLAM algorithm that estimates a dense 3D map representation which is more accurate than raw stereo measurements. Thereto, we run a sparse V-SLAM system, take the resulting pose estimates to compute a locally dense representation from dense stereo correspondences. This dense representation is expressed in local coordinate systems which are tracked as part of the SLAM estimate. This allows the dense part to be continuously updated. Our system is driven by visual odometry priors to achieve high robustness when tracking landmarks. Moreover, the sparse part of the SLAM system uses recently published sub mapping techniques to achieve constant runtime complexity most of the time. The improved accuracy over raw stereo measurements is shown in a Monte Carlo simulation. Finally, we demonstrate the feasibility of our method by presenting outdoor experiments of a car like robot.

[1]  Juan D. Tardós,et al.  Scalable SLAM building conditionally independent local maps , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Frank Dellaert,et al.  Flow separation for fast and robust stereo odometry , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[4]  Ian D. Reid,et al.  On combining visual SLAM and visual odometry , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Nobuyuki Kita,et al.  3D simultaneous localisation and map-building using active vision for a robot moving on undulating terrain , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[7]  Juan D. Tardós,et al.  Large-Scale SLAM Building Conditionally Independent Local Maps: Application to Monocular Vision , 2008, IEEE Transactions on Robotics.

[8]  Eduardo Mario Nebot,et al.  The HYbrid metric maps (HYMMs): a novel map representation for DenseSLAM , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  Frank Dellaert,et al.  Visual odometry priors for robust EKF-SLAM , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Jagath Samarabandu,et al.  Recent advances in simultaneous localization and map-building using computer vision , 2007, Adv. Robotics.

[11]  Andrew J. Davison,et al.  Live dense reconstruction with a single moving camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[14]  Sebastian Thrun,et al.  Simultaneous Localization and Mapping , 2008, Robotics and Cognitive Approaches to Spatial Mapping.

[15]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[16]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[17]  Ian D. Reid,et al.  Vast-scale Outdoor Navigation Using Adaptive Relative Bundle Adjustment , 2010, Int. J. Robotics Res..

[18]  Mohan M. Trivedi,et al.  Improving stereo camera depth measurements and benefiting from intermediate results , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[19]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Uwe Franke,et al.  Towards Optimal Stereo Analysis of Image Sequences , 2008, RobVis.

[21]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  Rudolf Mester,et al.  Free Space Computation Using Stochastic Occupancy Grids and Dynamic Programming , 2008 .

[23]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[24]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[25]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[26]  Gaurav S. Sukhatme,et al.  Bias Reduction and Filter Convergence for Long Range Stereo , 2005, ISRR.

[27]  Gerhard Lakemeyer,et al.  Exploring artificial intelligence in the new millennium , 2003 .

[28]  Eduardo Mario Nebot,et al.  DenseSLAM: Simultaneous Localization and Dense Mapping , 2006, Int. J. Robotics Res..

[29]  Henning Lategahn,et al.  Block-matching based optical flow estimation with reduced search space based on geometric constraints , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[30]  Ian D. Reid,et al.  Adaptive relative bundle adjustment , 2009, Robotics: Science and Systems.

[31]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[32]  Hugh Durrant-Whyte,et al.  Simultaneous Localisation and Mapping ( SLAM ) : Part I The Essential Algorithms , 2006 .

[33]  Alexander Bachmann,et al.  An iterative scheme for motion-based scene segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.