Sampling Algebraic Varieties for Robust Camera Autocalibration

This paper addresses the problem of robustly autocalibrating a moving camera with constant intrinsics. The proposed calibration method uses the Branch-and-Bound (BnB) search paradigm to maximize the consensus of the polynomials. These polynomials are parameterized by the entries of, either the Dual Image of Absolute Conic (DIAC) or the Plane-at-Infinity (PaI). During the BnB search, we exploit the theory of sampling algebraic varieties, to test the positivity of any polynomial within a parameter’s interval, i.e. outliers with certainty. The search process explores the space of exact parameters (i.e. the entries of DIAC or PaI), benefits from the solution of a local method, and converges to the solution satisfied by the largest number of polynomials. Given many polynomials on the sought parameters (with possibly overwhelmingly many from outlier measurements), their consensus for calibration is searched for two cases: simplified Kruppa’s equations and Modulus constraints, expressed in DIAC and PaI, resp. Our approach yields outstanding results in terms of robustness and optimality.

[1]  David Nistér,et al.  Untwisting a Projective Reconstruction , 2004, International Journal of Computer Vision.

[2]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[3]  Andrea Fusiello,et al.  Globally convergent autocalibration using interval analysis , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Pablo A. Parrilo,et al.  Semidefinite programming relaxations for semialgebraic problems , 2003, Math. Program..

[5]  Manolis I. A. Lourakis,et al.  Camera Self-Calibration Using the Singular Value Decomposition of the Fundamental Matrix: From Point Correspondences to 3D Measurements , 1999 .

[6]  Levente Hajder,et al.  A Minimal Solution for Two-View Focal-Length Estimation Using Two Affine Correspondences , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Long Quan,et al.  Self-calibration of an affine camera from multiple views , 1996, International Journal of Computer Vision.

[8]  Pablo A. Parrilo,et al.  Sampling Algebraic Varieties for Sum of Squares Programs , 2015, SIAM J. Optim..

[9]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Luc Van Gool,et al.  Euclidean 3D Reconstruction from Image Sequences with Variable Focal Lenghts , 1996, ECCV.

[11]  Ian D. Reid,et al.  Camera calibration and the search for infinity , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[13]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[14]  David Fofi,et al.  Efficient Pruning LMI Conditions for Branch-and-Prune Rank and Chirality-Constrained Estimation of the Dual Absolute Quadric , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Peter Sturm,et al.  On focal length calibration from two views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Anders Heyden,et al.  Minimal Conditions on Intrinsic Parameters for Euclidean Reconstruction , 1998, ACCV.

[17]  David J. Kriegman,et al.  Globally Optimal Affine and Metric Upgrades in Stratified Autocalibration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Jan Verschelde,et al.  Algorithm 795: PHCpack: a general-purpose solver for polynomial systems by homotopy continuation , 1999, TOMS.

[19]  Luc Van Gool,et al.  Stratified Self-Calibration with the Modulus Constraint , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[21]  G. Alefeld,et al.  Interval analysis: theory and applications , 2000 .

[22]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[23]  Alessio Del Bue,et al.  Practical Projective Structure from Motion (P2SfM) , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[24]  Roberto Cipolla,et al.  A linear iterative method for auto-calibration using the DAC equation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Andrea Fusiello,et al.  Practical Autocalibration , 2010, ECCV.

[26]  Carl Olsson,et al.  Stable Structure from Motion for Unordered Image Collections , 2011, SCIA.

[27]  Adrien Bartoli,et al.  Is dual linear self-calibration artificially ambiguous? , 2009, IEEE International Conference on Computer Vision.

[28]  Axel Pinz,et al.  Globally Optimal O(n) Solution to the PnP Problem for General Camera Models , 2008, BMVC.

[29]  Richard I. Hartley,et al.  Iterative Extensions of the Sturm/Triggs Algorithm: Convergence and Nonconvergence , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  P. Parrilo.  Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[31]  David J. Kriegman,et al.  Autocalibration via Rank-Constrained Estimation of the Absolute Quadric , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Janne Heikkilä.  Using Sparse Elimination for Solving Minimal Problems in Computer Vision , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Paulo R. S. Mendonça,et al.  A simple technique for self-calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[34]  Pascal Vasseur,et al.  Robust and Optimal Sum-of-Squares-Based Point-to-Plane Registration of Image Sets and Structured Scenes , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[35]  Lars Petersson,et al.  Globally-Optimal Inlier Set Maximisation for Simultaneous Camera Pose and Feature Correspondence , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.