Fast and Accurate Camera Covariance Computation for Large 3D Reconstruction

Estimating uncertainty of camera parameters computed in Structure from Motion (SfM) is an important tool for evaluating the quality of the reconstruction and guiding the reconstruction process. Yet, the quality of the estimated parameters of large reconstructions has been rarely evaluated due to the computational challenges. We present a new algorithm which employs the sparsity of the uncertainty propagation and speeds the computation up about ten times w.r.t. previous approaches. Our computation is accurate and does not use any approximations. We can compute uncertainties of thousands of cameras in tens of seconds on a standard PC. We also demonstrate that our approach can be effectively used for reconstructions of any size by applying it to smaller sub-reconstructions.

[1]  Martin Weinmann,et al.  3D Scene Analysis , 2016 .

[2]  Kenichi Kanatani,et al.  Gauges and gauge transformations for uncertainty description of geometric structure with indeterminacy , 2001, IEEE Trans. Inf. Theory.

[3]  Jan-Michael Frahm,et al.  Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset) , 2015, CVPR 2015.

[4]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[5]  Tomás Pajdla,et al.  Uncertainty Computation in Large 3D Reconstruction , 2017, SCIA.

[6]  Zuzana Kukelova,et al.  R6P - Rolling Shutter Absolute Camera Pose , 2015, CVPR 2015.

[7]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[8]  Wolfgang Förstner,et al.  Uncertainty and Projective Geometry , 2005 .

[9]  Takeo Kanade,et al.  Gauge freedoms and uncertainty modeling for three-dimensional computer vision , 2001 .

[10]  Viorela Ila,et al.  Fast Incremental Bundle Adjustment with Covariance Recovery , 2017, 2017 International Conference on 3D Vision (3DV).

[11]  Yongge Tian THE MOORE-PENROSE INVERSES OF M N BLOCK MATRICES AND THEIR APPLICATIONS , 1998 .

[12]  M. Nashed Generalized Inverses and Applications: Proceedings of an Advanced Seminar , 1976 .

[13]  Mathieu Perriollat,et al.  Uncertainty ellipsoids calculations for complex 3D reconstructions , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Zuzana Kukelova,et al.  R6P - Rolling shutter absolute pose problem , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Horst Bischof,et al.  Geo-referenced 3D reconstruction: Fusing public geographic data and aerial imagery , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[17]  Fuzhen Zhang The Schur complement and its applications , 2005 .

[18]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[19]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[20]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Frank Dellaert,et al.  Covariance recovery from a square root information matrix for data association , 2009, Robotics Auton. Syst..

[22]  Viorela Ila,et al.  SLAM++ 1 -A highly efficient and temporally scalable incremental SLAM framework , 2017, Int. J. Robotics Res..

[23]  Tomás Pajdla,et al.  Camera Uncertainty Computation in Large 3D Reconstruction , 2017, 2017 International Conference on 3D Vision (3DV).

[24]  Jan-Michael Frahm,et al.  Reconstructing the world* in six days , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[27]  Jack Dongarra,et al.  LAPACK: a portable linear algebra library for high-performance computers , 1990, SC.

[28]  Daniel P. Huttenlocher,et al.  Location Recognition Using Prioritized Feature Matching , 2010, ECCV.

[29]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Howard Whitley Eves,et al.  Elementary Matrix Theory , 1980 .

[31]  Viorela Ila,et al.  3D reconstruction quality analysis and its acceleration on GPU clusters , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).