Extracting Projective Information from Single Views of 3D Point Sets

A number of recent papers have argued that invariants do not exist for three dimensional point sets in general position 3, 5, 22]. This has often been misinterpreted to mean that invariants cannot be computed for any three dimensional structure. This paper proves by example that although the general statement is true, invariants do exist for structured three dimensional point sets. Projective invariants are derived for two classes of object: the rst is for points that lie on the vertices of polyhedra, and the second for objects that are projectively equivalent to ones possessing a bilateral symmetry. The rst approach to computing invariants is not restricted to measurements on physical poly-hedra, but extends to more general structures whose features can be embedded within conceptual polyhedra. This is a result of using an algebraic framework of constraints between points and planes, and yet not having to observe any actual plane faces. This is called caging. The motivations for computing such invariants are twofold: rstly they can be used for recognition; secondly they can be used to compute projective structure. Examples of invariants computed from real images are given.

[1]  Alan K. Mackworth Interpreting Pictures of Polyhedral Scenes , 1973, IJCAI.

[2]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[3]  K. Sugihara Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  D. W. Thompson,et al.  Three-dimensional model matching from an unconstrained viewpoint , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[7]  David W. Murray,et al.  Model-based recognition using 3D structure from motion , 1987, Image Vis. Comput..

[8]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Isaac Weiss,et al.  Projective invariants of shapes , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Tony P. Pridmore,et al.  Geometrical Modeling from Multiple Stereo Views , 1989, Int. J. Robotics Res..

[11]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Long Quan,et al.  Towards structure from motion for linear features through reference points , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[13]  David W. Jacobs,et al.  Model group indexing for recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Luce Morin,et al.  Relative positioning from geometric invariants , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Peter C. Wayner,et al.  Efficiently using invariant theory for model-based matching , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  P. Beardsley,et al.  Affine and Projective Structure from Motion , 1992 .

[17]  Edward M. Riseman,et al.  The non-existence of general-case view-invariants , 1992 .

[18]  David A. Forsyth,et al.  Efficient model library access by projectively invariant indexing functions , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[20]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Shimon Ullman,et al.  Limitations of Non Model-Based Recognition Schemes , 1992, ECCV.

[22]  Gunnar Sparr Depth computations from polyhedral images , 1992, Image Vis. Comput..

[23]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .