The Geometry of Projective Reconstruction I: Matching Constraints and the Joint Image

This paper studies the geometry of perspective projection into multiple images and the matching constraints that this induces between the images. The combined projections produce a 3D subspace of the space of combined image coordinates called the joint image. This is a complete projective replica of the 3D world defined entirely in terms of image coordinates, up to an arbitrary choice of certain scale factors. Projective reconstruction is a canonical process in the joint image requiring only the rescaling of image coordinates. The matching constraints tell whether a set of image points is the projection of a single world point. In 3D there are only three types of matching constraint: the fundamental matrix, Shashua's trilinear tensor, and a new quadrilinear 4 image tensor. All of these fit into a single geometric object, the joint image Grassmannian tensor. This encodes exactly the information needed for reconstruction: the location of the joint image in the space of combined image coordinates.

[1]  W. V. Hodge,et al.  Methods of algebraic geometry , 1947 .

[2]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[3]  R. Penrose,et al.  Two-spinor calculus and relativistic fields , 1984 .

[4]  R. Penrose,et al.  Spinors and Space–Time: Subject and author index , 1984 .

[5]  R. Penrose,et al.  Spinors and Space‐Time, Volume I: Two‐Spinor Calculus and Relativistic Fields , 1986 .

[6]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[7]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[8]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[10]  Roger Mohr,et al.  Accurate Relative Positioning From Multiple Images , 1993 .

[11]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[12]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[13]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[14]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[15]  Amnon Shashua,et al.  Algebraic Functions For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  David W. Murray,et al.  A unifying framework for structure and motion recovery from image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[17]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.