Camera Pose Estimation from Lines using Plücker Coordinates

Correspondences between 3D lines and their 2D images captured by a camera are often used to determine position and orientation of the camera in space. In this work, we propose a novel algebraic algorithm to estimate the camera pose. We parameterize 3D lines using Pl\"ucker coordinates that allow linear projection of the lines into the image. A line projection matrix is estimated using Linear Least Squares and the camera pose is then extracted from the matrix. An algebraic approach to handle mismatched line correspondences is also included. The proposed algorithm is an order of magnitude faster yet comparably accurate and robust to the state-of-the-art, it does not require initialization, and it yields only one solution. The described method requires at least 9 lines and is particularly suitable for scenarios with 25 and more lines, as also shown in the results.

[1]  Adrien Bartoli,et al.  Structure-from-motion using lines: Representation, triangulation, and bundle adjustment , 2005, Comput. Vis. Image Underst..

[2]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Stergios I. Roumeliotis,et al.  Globally optimal pose estimation from line correspondences , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Stéphane Christy,et al.  Iterative Pose Computation from Line Correspondences , 1999, Comput. Vis. Image Underst..

[5]  Janne Heikkilä,et al.  Line Matching and Pose Estimation for Unconstrained Model-to-Image Alignment , 2014, 2014 2nd International Conference on 3D Vision.

[6]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .

[7]  Olivier D. Faugeras,et al.  Determination of Camera Location from 2-D to 3-D Line and Point Correspondences , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Adrien Bartoli,et al.  The 3D Line Motion Matrix and Alignment of Line Reconstructions , 2004, International Journal of Computer Vision.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Kostas Daniilidis,et al.  Linear Pose Estimation from Points or Lines , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Pavel Zem Camera Pose Estimation from Lines using Plücker Coordinates , 2016 .

[13]  Richard Hartley,et al.  Minimizing algebraic error , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  G. M.,et al.  Projective Geometry , 1938, Nature.

[16]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[17]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[18]  Francesc Moreno-Noguer,et al.  Very Fast Solution to the PnP Problem with Algebraic Outlier Rejection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[20]  Reinhard Koch,et al.  Robust and Efficient Pose Estimation from Line Correspondences , 2012, ACCV.

[21]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Homer H. Chen Pose Determination from Line-to-Plane Correspondences: Existence Condition and Closed-Form Solutions , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Philip David,et al.  Simultaneous pose and correspondence determination using line features , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[24]  Kostas Daniilidis,et al.  Linear Pose Estimation from Points or Lines , 2002, ECCV.

[25]  Yubin Kuang,et al.  Pose Estimation with Unknown Focal Length Using Points, Directions and Lines , 2013, 2013 IEEE International Conference on Computer Vision.

[26]  Homer H. Chen,et al.  Pose determination from line-to-plane correspondences: existence condition and closed-form solutions , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[27]  Jochen Trumpf,et al.  $${L_q}$$Lq-Closest-Point to Affine Subspaces Using the Generalized Weiszfeld Algorithm , 2015, International Journal of Computer Vision.

[28]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Adrien Bartoli,et al.  The 3D Line Motion Matrix and Alignment of Line Reconstructions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.