A general solution to the P4P problem for camera with unknown focal length

This paper presents a general solution to the determination of the pose of a perspective camera with unknown focal length from images of four 3D reference points. Our problem is a generalization of the P3P and P4P problems previously developed for fully calibrated cameras. Given four 2D-to-3D correspondences, we estimate camera position, orientation and recover the camera focal length. We formulate the problem and provide a minimal solution from four points by solving a system of algebraic equations. We compare the Hidden variable resultant and Grobner basis techniques for solving the algebraic equations of our problem. By evaluating them on synthetic and on real-data, we show that the Grobner basis technique provides stable results.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[4]  Mongi A. Abidi,et al.  A New Efficient and Direct Solution for Pose Estimation Using Quadrangular Targets: Algorithm and Evaluation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  David A. Cox,et al.  Ideals, Varieties, and Algorithms , 1997 .

[6]  David A. Cox,et al.  Using Algebraic Geometry , 1998 .

[7]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  B. Triggs,et al.  Camera Pose Revisited -- New Linear Algorithms , 2000 .

[9]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[10]  L. Zhi,et al.  A Complete Linear 4-Point Algorithm for Camera Pose Determination 1 ) , 2003 .

[11]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Lihong Zhi,et al.  A complete symbolic-numeric linear method for camera pose determination , 2003, ISSAC '03.

[13]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[14]  Long Quan,et al.  Some Results on Minimal Euclidean Reconstruction from Four Points , 2006, Journal of Mathematical Imaging and Vision.

[15]  Zhanyi Hu,et al.  PnP Problem Revisited , 2005, Journal of Mathematical Imaging and Vision.

[16]  David Nister,et al.  Recent developments on direct relative orientation , 2006 .

[17]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[18]  Zuzana Kukelova,et al.  A minimal solution to the autocalibration of radial distortion , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Vincent Lepetit,et al.  Accurate Non-Iterative O(n) Solution to the PnP Problem , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[20]  Martin Byröd,et al.  Improving Numerical Accuracy of Gröbner Basis Polynomial Equation Solvers , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Luc Van Gool,et al.  Coupled Detection and Trajectory Estimation for Multi-Object Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Luc Van Gool,et al.  Dynamic 3D Scene Analysis from a Moving Vehicle , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.