The importance of measurement uncertainty modelling in the feature-based RGB-D SLAM

This paper presents an analysis of the role of measurements uncertainty in the feature-based RGB-D SLAM formulated as graph optimization problem. The considered SLAM solution uses global graph optimization to find the trajectory of the RGB-D camera and a set of 3D point features constituting the map. In order to focus on the optimization back-end details and isolate the results from the data association errors caused by the image processing front-end in a real SLAM system we introduce a simulation environment, which allows to clearly show the influence of the uncertainty model on the accuracy of the obtained trajectories. We demonstrate a substantial improvement in the trajectory accuracy due to using in the graph optimization process an uncertainty model based on the physical properties of the RGB-D sensor. Moreover, we investigate the influence of the RGB-D camera motion strategy on the accuracy of the SLAM solution, pointing out the relation between this strategy and the measurement uncertainty model.

[1]  John J. Leonard,et al.  Robust real-time visual odometry for dense RGB-D mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[3]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[4]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[5]  Piotr Skrzypczynski,et al.  Precise self-localization of a walking robot on rough terrain using parallel tracking and mapping , 2013, Ind. Robot.

[6]  Adam Schmidt,et al.  Comparative Assessment of Point Feature Detectors and Descriptors in the Context of Robot Navigation , 2013 .

[7]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[8]  Piotr Skrzypczynski,et al.  Spatial Uncertainty Management for Simultaneous Localization and Mapping , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  Wolfram Burgard,et al.  3-D Mapping With an RGB-D Camera , 2014, IEEE Transactions on Robotics.

[10]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Andrew J. Davison,et al.  A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Michal R. Nowicki,et al.  On the Performance of Pose-Based RGB-D Visual Navigation Systems , 2014, ACCV.

[13]  Moonhong Baeg,et al.  Spatial Uncertainty Model for Visual Features Using a Kinect™ Sensor , 2012, Sensors.

[14]  Marek Kraft,et al.  Comparative assessment of point feature detectors in the context of robot navigation , 2013 .

[15]  Michel Dhome,et al.  Generic and real-time structure from motion using local bundle adjustment , 2009, Image Vis. Comput..

[16]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[17]  Paul Ozog,et al.  On the importance of modeling camera calibration uncertainty in visual SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[19]  Robert M. Haralick.  Propagating covariance in computer vision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[20]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[23]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.