Direct computation of 3-D shape and motion invariants

Structure from motion often refers to the computation of 3D structure from a matched sequence of images. However, a depth map of a surface is difficult to compute and may not be a good representation for storage and recognition. Given matched images, I will first show that the sign of the normal curvature in a given direction at a given point in the image can be computed from a simple difference of slopes of line-segments in one image. Using this result, local surface patches can be classified as convex, concave, parabolic (cylindrical), hyperbolic (saddle point) or planar. At the same time the translational component of the optical flow is obtained, from which the focus of expansion can be computed.

[1]  A.L Yuille,et al.  Zero crossings on lines of curvature , 1989, Comput. Vis. Graph. Image Process..

[2]  Shimon Ullman,et al.  Computational Studies in the Interpretation of Structure and Motion: Summary and Extension , 1983 .

[3]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[4]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Randal C. Nelson,et al.  Using Flow Field Divergence For Obstacle Avoidance: Towards Qualitative Vision , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[6]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Alessandro Verri,et al.  Against Quantitative Optical Flow , 1987 .

[8]  H. Bülthoff,et al.  INTERACTION OF DIFFERENT MODULES IN DEPTH PERCEPTION. , 1987, ICCV 1987.

[9]  Shimon Edelman,et al.  Integrating visual cues for object segmentation and recognition , 1989 .

[10]  L. Matin.  Eye Movements and Perceived Visual Direction , 1972 .

[11]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[12]  Jan J. Koenderink,et al.  Local structure of movement parallax of the plane , 1976 .

[13]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[14]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  M. Brady.  Criteria for Representations of Shape , 1983 .

[16]  Daphna Weinshall,et al.  Qualitative Depth from Stereo, with Applications , 1990, Comput. Vis. Graph. Image Process..