Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition

The author addresses the problems of reconstructing 3-D space in a projective framework from two views and of artificially generating novel views of the scene from two given views. It is shown that with the correspondences coming from four non-coplanar points in the scene and the corresponding epipoles, it is possible to define and reconstruct a projective invariant, referred to as projective depth, that can be used later to reconstruct the projective or affine structure of the scene or directly to generate novel views of the scene. The derivation has the advantage that the viewing transformation matrix need not be recovered in the course of computations.<<ETX>>

[1]  G. M.,et al.  Projective Geometry , 1938, Nature.

[2]  David Gans,et al.  Transformations and geometries , 1969 .

[3]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[4]  Chia-Hoang Lee.  Structure And Motion From Two Perspective Views Via Planar Patch , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[5]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[6]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  O. Faugeras,et al.  Motion from point matches: Multiplicity of solutions , 1989, [1989] Proceedings. Workshop on Visual Motion.

[8]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[9]  M. A. Snyder,et al.  Robustness of correspondence-based structure from motion , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[10]  Eamon B. Barrett,et al.  General methods for determining projective invariants in imagery , 1991, CVGIP Image Underst..

[11]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[12]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Andrew Zisserman,et al.  Appendix—projective geometry for machine vision , 1992 .

[14]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[15]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Shimon Ullman,et al.  Contour matching using local affine transformations , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1995, Int. J. Robotics Res..