Minimal projective reconstruction for combinations of points and lines in three views

In this paper we address the problem of projective reconstruction of structure and motion given only image data. In particular we investigate three novel minimal combinations of points and lines over three views, and give complete solutions and reconstruction methods for two of these cases: “four points and three lines in three views”, and “two points and six lines in three views”. We show that in general there are three and seven solutions respectively to these cases. The reconstruction methods are tested on real and simulated data. We also give tentative results for the case of nine lines in correspondence over three views, where experiments indicate that there may be up to 36 complex solutions.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Narendra Ahuja,et al.  Estimating motion/structure from line correspondences: a robust linear algorithm and uniqueness theorems , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  A. Mitiche,et al.  On combining points and lines in an image sequence to recover 3D structure and motion , 1989, [1989] Proceedings. Workshop on Visual Motion.

[4]  Olivier D. Faugeras,et al.  Feed-forward recovery of motion and structure from a sequence of 2D-lines matches , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[5]  Thomas Buchanan,et al.  Critical Sets for 3D Reconstruction Using Lines , 1992, ECCV.

[6]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Richard I. Hartley,et al.  Projective reconstruction from line correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Long Quan,et al.  Invariants of Six Points and Projective Reconstruction From Three Uncalibrated Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[11]  A. Heyden.  Geometry and algebra of multiple projective transformations , 1995 .

[12]  Robert J. Holt,et al.  Uniqueness of Solutions to Structure and Motion from Combinations of Point and Line Correspondences , 1996, J. Vis. Commun. Image Represent..

[13]  Andrew Zisserman,et al.  Robust Parameterization and Computation of the Trifocal Tensor , 1996, BMVC.

[14]  Takeo Kanade,et al.  Affine structure from line correspondences with uncalibrated affine cameras , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Long Quan.  Uncalibrated 1D projective camera and 3D affine reconstruction of lines , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Robert J. Holt,et al.  Motion and structure from line correspondences under orthographic projection , 1997, Int. J. Imaging Syst. Technol..

[17]  David A. Cox,et al.  Using Algebraic Geometry , 1998 .

[18]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[19]  Bill Triggs,et al.  Camera pose and calibration from 4 or 5 known 3D points , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  A. Heyden,et al.  Structure and motion from lines under affine projections , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Jan Verschelde,et al.  Algorithm 795: PHCpack: a general-purpose solver for polynomial systems by homotopy continuation , 1999, TOMS.

[22]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[23]  Richard I. Hartley,et al.  Critical configurations for n-view projective reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Minas E. Spetsakis,et al.  Structure from motion using line correspondences , 1990, International Journal of Computer Vision.

[25]  Richard I. Hartley,et al.  Lines and Points in Three Views and the Trifocal Tensor , 1997, International Journal of Computer Vision.