A probabilistic approach to camera pose and calibration from a small set of point and line correspondences

We present a new method for solving the problem of camera pose and calibration from a limited number of correspondences between noisy 2D and 3D features. We show that the probabilistic estimation problem can be expressed as a partially linear problem, where point and line correspondences are mixed using a common formulation. Our Sampling-Solving algorithm enables to robustly estimate the parameters and evaluate the probability distribution of the estimated parameters. It solves the problem of pose estimation with unknown focal length using a minimum of only four correspondences (five if the principal point is also unknown). To our knowledge, this is the first calibration method using so few correspondences of both points and lines. Experimental results show that the algorithm is very robust to Gaussian noise, even for minimal data sets. Finally, some tests show the potential of global uncertainty estimates on real data sets.

[1]  Ioannis Stamos,et al.  A systematic approach for 2D-image to 3D-range registration in urban environments , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[3]  Christian Früh,et al.  Constructing 3D city models by merging ground-based and airborne views , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Ioannis Stamos,et al.  Automatic registration of 2-D with 3-D imagery in urban environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  E. Saff,et al.  Distributing many points on a sphere , 1997 .

[6]  Gene H. Golub,et al.  The differentiation of pseudo-inverses and non-linear least squares problems whose variables separate , 1972, Milestones in Matrix Computation.

[7]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[8]  Ioannis Stamos,et al.  3-D model construction using range and image data , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Ioannis Stamos,et al.  Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes , 2008, International Journal of Computer Vision.

[10]  Bill Triggs,et al.  Camera pose and calibration from 4 or 5 known 3D points , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  G. Golub,et al.  Separable nonlinear least squares: the variable projection method and its applications , 2003 .

[12]  C. Engels,et al.  GLOBAL UNCERTAINTY IN EPIPOLAR GEOMETRY VIA FULLY AND PARTIALLY DATA-DRIVEN SAMPLING , 2005 .

[13]  Fadi Dornaika,et al.  Robust camera calibration using 2D-to-3D feature correspondences , 1997, Optics & Photonics.

[14]  William H. Press,et al.  Numerical recipes in C , 2002 .

[15]  Zuzana Kukelova,et al.  A general solution to the P4P problem for camera with unknown focal length , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Charles V. Stewart,et al.  Estimating the Location of a Camera with Respect to a 3D Model , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[17]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[18]  Ioannis Stamos,et al.  Automatic 3D to 2D registration for the photorealistic rendering of urban scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  David Nister,et al.  Alignment of continuous video onto 3D point clouds , 2004, CVPR 2004.

[20]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Martin Byröd,et al.  Image-Based Localization Using Hybrid Feature Correspondences , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[23]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..