On the importance of modeling camera calibration uncertainty in visual SLAM

This paper reports on methods for incorporating camera calibration uncertainty into a two-view sparse bundle adjustment (SBA) framework. The co-registration of two images is useful in mobile robotics for determining motion over time. These camera measurements can constrain a robot's relative poses so that the trajectory and map can be estimated in a technique known as simultaneous localization and mapping (SLAM). Here, we comment on the importance of propagating uncertainty in both feature extraction and camera calibration in visual pose-graph SLAM. We derive an improved pose covariance estimate that leverages the Unscented Transform, and compare its performance to previous methods in both simulated and experimental trials. The two experiments reported here involve data from a camera mounted on a KUKA robotic arm (where a precise ground-truth trajectory is available) and a Hovering Autonomous Underwater Vehicle (HAUV) for large-scale autonomous ship hull inspection.

[1]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[3]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[4]  Tomás Svoboda,et al.  A Badly Calibrated Camera in Ego-Motion Estimation Propagation of Uncertainty , 1997, CAIP.

[5]  Wolfram Burgard,et al.  Online constraint network optimization for efficient maximum likelihood map learning , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  Paul Newman,et al.  LAPS - localisation using appearance of prior structure: 6-DoF monocular camera localisation using prior pointclouds , 2012, 2012 IEEE International Conference on Robotics and Automation.

[7]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[8]  José Santos-Victor,et al.  Uncertainty analysis of 3D reconstruction from uncalibrated views , 2000, Image Vis. Comput..

[9]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[10]  Peter Sturm,et al.  What can be done with a Badly Calibrated Camera in Ego-Motion Estimation? , 1996 .

[11]  Hanumant Singh,et al.  Exactly Sparse Delayed-State Filters for View-Based SLAM , 2006, IEEE Transactions on Robotics.

[12]  Frank Dellaert,et al.  Covariance recovery from a square root information matrix for data association , 2009, Robotics Auton. Syst..

[13]  Frank Dellaert,et al.  Incremental smoothing and mapping , 2008 .

[14]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[16]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[17]  Simon J. Julier,et al.  The scaled unscented transformation , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[18]  Stefan B. Williams,et al.  Bundle adjustment in large-scale 3D reconstructions based on underwater robotic surveys , 2011, OCEANS 2011 IEEE - Spain.

[19]  Ryan M. Eustice,et al.  Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency , 2013, IEEE Transactions on Robotics.

[20]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[21]  Robert M. Haralick.  Propagating covariance in computer vision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[22]  Ginés García Mateos.  A CAMERA CALIBRATION TECHNIQUE USING TARGETS OF CIRCULAR FEATURES , 2000 .

[23]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[24]  Nassir Navab,et al.  Estimation of Location Uncertainty for Scale Invariant Features Points , 2009, BMVC.

[25]  Abed Malti,et al.  Feature detection and matching in images with radial distortion , 2010, 2010 IEEE International Conference on Robotics and Automation.

[26]  Edwin Olson,et al.  Fast iterative alignment of pose graphs with poor initial estimates , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[27]  Jana Kosecka,et al.  Motion bias and structure distortion induced by intrinsic calibration errors , 2008, Image Vis. Comput..

[28]  Frank Dellaert,et al.  Probabilistic structure matching for visual SLAM with a multi-camera rig , 2010, Comput. Vis. Image Underst..

[29]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..