Solving the perspective-three-point problem with linear combinations: An accurate and efficient method

Abstract In this paper, we present an efficient algebraic solution to the perspective-three-point (P3P) problem that estimates the pose of a fully-calibrated camera from three given 3D-2D point correspondences. Previous P3P approaches typically solve for two sets of parameters: the depths of three 3D points and the pose of the camera. In contrast, our formulation does not involve any depth factor, and therefore can provide a more compact derivation for the P3P problem. By representing the involved rotation matrix and translation vector as a linear combination of known vectors with unknown coefficients and employing the orthogonal nature of the rotation matrix, this formulation finally leads to a univariate quartic equation which can be solved in closed form. The resulting algorithm is easy to understand and implement as it relies substantially on linear algebra. Experimental results demonstrate that the presented method can achieve a comparable accuracy to the state-of-the-art methods, but with significantly reduced computational requirements.

[1]  Michael Q. Rieck A Fundamentally New View of the Perspective Three-Point Pose Problem , 2013, Journal of Mathematical Imaging and Vision.

[2]  Stergios I. Roumeliotis,et al.  An Efficient Algebraic Solution to the Perspective-Three-Point Problem , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael J. Magee,et al.  The Perspective View of Three Points , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jie Wang,et al.  A novel linear algorithm for P5P problem , 2008, Appl. Math. Comput..

[6]  Michael Vynnycky,et al.  Mathematical Analysis of the Multisolution Phenomenon in the P3P Problem , 2014, Journal of Mathematical Imaging and Vision.

[7]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[8]  Michael Vynnycky,et al.  On the Effect of Control-Point Spacing on the Multisolution Phenomenon in the P3P Problem , 2018 .

[9]  Yubin Kuang,et al.  Revisiting the PnP Problem: A Fast, General and Optimal Solution , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Robert M. Haralick,et al.  Analysis and solutions of the three point perspective pose estimation problem , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Michael Q. Rieck Related Solutions to the Perspective Three-Point Pose Problem , 2015, Journal of Mathematical Imaging and Vision.

[13]  Zuzana Kukelova,et al.  Real-Time Solution to the Absolute Pose Problem with Unknown Radial Distortion and Focal Length , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[15]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[16]  Atsuhiko Banno A P3P problem solver representing all parameters as a linear combination , 2018, Image Vis. Comput..

[17]  Francesc Moreno-Noguer,et al.  Exhaustive Linearization for Robust Camera Pose and Focal Length Estimation , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Zuzana Kukelova,et al.  Automatic Generator of Minimal Problem Solvers , 2008, ECCV.

[19]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Zhanyi Hu,et al.  A Note on the Number of Solutions of the Noncoplanar P4P Problem , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Xuesong Zhang,et al.  ACPNP: an Efficient Solution for Absolute Camera Pose Estimation from Two Affine Correspondences , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[22]  Mikael Persson,et al.  Lambda Twist: An Accurate Fast Robust Perspective Three Point (P3P) Solver , 2018, ECCV.

[23]  Andreas Zell,et al.  A New Geometric Approach for Faster Solving the Perspective-Three-Point Problem , 2014, 2014 22nd International Conference on Pattern Recognition.