Complete scene structure from four point correspondences

A technique is presented for computing 3D scene structure from point and line features in monocular image sequences. Unlike previous methods, the technique guarantees the completeness of the recovered scene, ensuring that every scene feature that is detected in each image is reconstructed. The approach relies on the presence of four or more reference features whose correspondences are known in all the images. Under an orthographic or affine camera model, the parallax of the reference features provides constraints that simplify the recovery of the rest of the visible scene. An efficient recursive algorithm is described that uses a unified framework for point and line features. The algorithm integrates the tasks of feature correspondence and structure recovery, ensuring that all reconstructible features are tracked. In addition, the algorithm is immune to outliers and feature drift, two weaknesses of existing structure from motion techniques. Experimental results are presented for real images.<<ETX>>

[1]  MoritaToshihiko,et al.  A Sequential Factorization Method for Recovering Shape and Motion From Image Streams , 1997 .

[2]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[3]  Thomas S. Huang,et al.  Finding point correspondences and determining motion of a rigid object from two weak perspective views , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Kiriakos N. Kutulakos,et al.  Global surface reconstruction by purposive control of observer motion , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Takeo Kanade,et al.  A sequential factorization method for recovering shape and motion from image streams , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[8]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[9]  G. Borgefors Distance transformations in arbitrary dimensions , 1984 .

[10]  Andrew Zisserman,et al.  Motion From Point Matches Using Affine Epipolar Geometry , 1994, ECCV.

[11]  Nicholas Ayache,et al.  Trinocular Stereo Vision for Robotics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[13]  R. Basri On the Uniqueness of Correspondence from Orthographic and Perspective Projection , 1992 .

[14]  R. Basri On the Uniqueness of Correspondence under Orthographic and Perspective Projections , 1991 .