A ne Structure from Line Correspondences with Uncalibrated A ne Cameras

|This paper presents a linear algorithm for recovering 3D a ne shape and motion from line correspondences with uncalibrated a ne cameras. The algorithm requires a minimum of seven line correspondences over three views. The key idea is the introduction of a one-dimensional projective camera. This converts 3D a ne reconstruction of \line directions" into 2D projective reconstruction of \points". In addition, a line-based factorisation method is also proposed to handle redundant views. Experimental results both on simulated and real image sequences validate the robustness and the accuracy of the algorithm. Key-words: structure from motion, a ne structure, factorisation method, line correspondence, a ne camera, one-dimensional camera, uncalibrated image.

[1]  S. Ullman.  The Interpretation of Visual Motion , 1979 .

[2]  Toshiyuki Sakai,et al.  Obtaining Surface Orientation from Texels under Perspective Projection , 1981, IJCAI.

[3]  Thomas S. Huang,et al.  Estimation of rigid body motion using straight line correspondences , 1986, Comput. Vis. Graph. Image Process..

[4]  Thomas S. Huang,et al.  A linear algorithm for motion estimation using straight line correspondences , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[5]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Yiannis Aloimonos,et al.  Perspective approximations , 1990, Image Vis. Comput..

[7]  Thomas S. Huang,et al.  Finding point correspondences and determining motion of a rigid object from two weak perspective views , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Olivier Faugeras,et al.  3D Dynamic Scene Analysis , 1992 .

[10]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[11]  Olivier Faugeras,et al.  3D Dynamic Scene Analysis: A Stereo Based Approach , 1992 .

[12]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[13]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Quang-Tuan Luong.  Matrice fondamentale et autocalibration en vision par ordinateur , 1992 .

[16]  T. Q. Phong,et al.  Optimal estimation of object pose from a single perspective view , 1993, 1993 (4th) International Conference on Computer Vision.

[17]  Bernd Sturmfels,et al.  Algorithms in invariant theory , 1993, Texts and monographs in symbolic computation.

[18]  Daphna Weinshall,et al.  Linear and incremental acquisition of invariant shape models from image sequences , 1993, 1993 (4th) International Conference on Computer Vision.

[19]  Ian D. Reid,et al.  Recursive Affine Structure and Motion from Image Sequences , 1994, ECCV.

[20]  Richard I. Hartley,et al.  Projective reconstruction from line correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, ECCV.

[22]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[23]  Amnon Shashua,et al.  Algebraic Functions For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1995, Int. J. Robotics Res..

[25]  Long Quan,et al.  Invariants of Six Points and Projective Reconstruction From Three Uncalibrated Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Paul A. Beardsley,et al.  Active visual navigation using non-metric structure , 1995, Proceedings of IEEE International Conference on Computer Vision.

[27]  Bill Triggs,et al.  Matching constraints and the joint image , 1995, Proceedings of IEEE International Conference on Computer Vision.

[28]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[29]  Takeo Kanade,et al.  A factorization method for affine structure from line correspondences , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[31]  Richard Hartley,et al.  Lines and Points in Three Views - An Integrated Approach , 2001 .

[32]  S. Ullman,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..