Camera Pose Estimation Using First-Order Curve Differential Geometry

This paper considers and solves the problem of estimating camera pose given a pair of point-tangent correspondences between the 3D scene and the projected image. The problem arises when considering curve geometry as the basis of forming correspondences, computation of structure and calibration, which in its simplest form is a point augmented with the curve tangent. We show that while the standard resectioning problem is solved with a minimum of three points given the intrinsic parameters, when points are augmented with tangent information only two points are required, leading to substantial computational savings, e.g., when used as a minimal engine within ransac. In addition, computational algorithms are developed to find a practical and efficient solution shown to effectively recover camera pose using both synthetic and realistic datasets. The resolution of this problem is intended as a basic building block of future curve-based structure from motion systems, allowing new views to be incrementally registered to a core set of views for which relative pose has already been computed.

[1]  Yubin Kuang,et al.  Pose Estimation with Unknown Focal Length Using Points, Directions and Lines , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Anders Heyden,et al.  Using conic correspondences in two images to estimate the epipolar geometry , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[3]  Benjamin B. Kimia,et al.  No Grouping Left Behind: From Edges to Curve Fragments , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  John Porrill,et al.  Curve matching and stereo calibration , 1991, Image Vis. Comput..

[5]  Benjamin B. Kimia,et al.  High-Order Differential Geometry of Curves for Multiview Reconstruction and Matching , 2005, EMMCVPR.

[6]  Benjamin B. Kimia,et al.  3D curve sketch: Flexible curve-based stereo reconstruction and calibration , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[8]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[9]  Pietro Perona,et al.  Evaluation of Features Detectors and Descriptors Based on 3D Objects , 2005, ICCV.

[10]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Roberto Cipolla,et al.  The visual motion of curves and surfaces , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[12]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  G. Volkart Das Rückwärtseinschneiden im Raum , 1933 .

[14]  Benjamin B. Kimia,et al.  A Multi-stage Approach to Curve Extraction , 2014, ECCV.

[15]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[16]  Zhanyi Hu,et al.  A Note on the Number of Solutions of the Noncoplanar P4P Problem , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Sudipta N. Sinha,et al.  Camera network calibration from dynamic silhouettes , 2004, CVPR 2004.

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Robert M. Haralick,et al.  Review and analysis of solutions of the three point perspective pose estimation problem , 1994, International Journal of Computer Vision.

[20]  Hideo Saito,et al.  Sharing 3D object with multiple clients via networks using vision-based 3D object tracking , 2014, VRIC.

[21]  Zuzana Kukelova,et al.  A general solution to the P4P problem for camera with unknown focal length , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Veronica Teichrieb,et al.  Challenges in 3D Reconstruction from Images for Difficult Large-Scale Objects: A Study on the Modeling of Electrical Substations , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[23]  Olivier D. Faugeras,et al.  Curve-based stereo: figural continuity and curvature , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Amnon Shashua,et al.  Multiple View Geometry of General Algebraic Curves , 2004, International Journal of Computer Vision.

[25]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[26]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[27]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.