Online SLAM with any-time self-calibration and automatic change detection

A framework for online simultaneous localization, mapping and self-calibration is presented which can detect and handle significant change in the calibration parameters. Estimates are computed in constant-time by factoring the problem and focusing on segments of the trajectory that are most informative for the purposes of calibration. A novel technique is presented to detect the probability that a significant change is present in the calibration parameters. The system is then able to re-calibrate. Maximum likelihood trajectory and map estimates are computed using an asynchronous and adaptive optimization. The system requires no prior information and is able to initialize without any special motions or routines, or in the case where observability over calibration parameters is delayed. The system is experimentally validated to calibrate camera intrinsic parameters for a nonlinear camera model on a monocular dataset featuring a significant zoom event partway through, and achieves high accuracy despite unknown initial calibration parameters. Self-calibration and re-calibration parameters are shown to closely match estimates computed using a calibration target. The accuracy of the system is demonstrated with SLAM results that achieve sub-1% distance-travel error even in the presence of significant re-calibration events.

[1]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[3]  Rachid Deriche,et al.  Camera Self-Calibration Using the Kruppa Equations and the SVD of the Fundamental Matrix: The Case of Varying Intrinsic Parameters , 2000 .

[4]  Reinhard Koch,et al.  Camera calibration with known rotation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Ian D. Reid,et al.  RSLAM: A System for Large-Scale Mapping in Constant-Time Using Stereo , 2011, International Journal of Computer Vision.

[6]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Anastasios I. Mourikis,et al.  3-D motion estimation and online temporal calibration for camera-IMU systems , 2013, 2013 IEEE International Conference on Robotics and Automation.

[8]  Peter Kulchyski.  and , 2015 .

[9]  Javier Civera,et al.  Camera self-calibration for sequential Bayesian structure from motion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[11]  Roland Siegwart,et al.  Keyframe-based Visual-Inertial SLAM using Nonlinear Optimization , 2013, RSS 2013.

[12]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Anastasios I. Mourikis,et al.  High-precision, consistent EKF-based visual-inertial odometry , 2013, Int. J. Robotics Res..

[14]  Allan S. Cohen,et al.  On the Behrens-Fisher Problem: A Review , 1998 .

[15]  Ian D. Reid,et al.  Self-Calibration of a Rotating Camera with Varying Intrinsic Parameters , 1998, BMVC.

[16]  Gabe Sibley,et al.  Asynchronous Adaptive Conditioning for Visual-Inertial SLAM , 2014, ISER.

[17]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[18]  Gabe Sibley,et al.  Constant-time monocular self-calibration , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[19]  Ying Yao,et al.  An approximate degrees of freedom solution to the multivariate Behrens-Fisher problem* , 1965 .

[20]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[21]  SnavelyNoah,et al.  Modeling the World from Internet Photo Collections , 2008 .

[22]  Anastasios I. Mourikis,et al.  High-fidelity sensor modeling and self-calibration in vision-aided inertial navigation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Roland Siegwart,et al.  Automatic self-calibration of a vision system during robot motion , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Bimal K. Sinha,et al.  Some Aspects of Multivariate Behrens-Fisher Problem , 2009 .

[25]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Luc Van Gool,et al.  Euclidean 3D Reconstruction from Image Sequences with Variable Focal Lenghts , 1996, ECCV.

[27]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.