Inferring Structure from Motion in Two-View and Multiview Displays

Five experiments were conducted to examine constraints used to interpret structure-from-motion displays. Theoretically, two orthographic views of four or more points in rigid motion yield a one-parameter family of rigid three-dimensional (3-D) interpretations. Additional views yield a unique rigid interpretation. Subjects viewed two-view and thirty-view displays of five-point objects in apparent motion. The subjects selected the best 3-D interpretation from a set of 89 compatible alternatives (experiments 1–3) or judged depth directly (experiment 4). In both cases the judged depth increased when relative image motion increased, even when the increased motion was due to increased simulation rotation. Subjects also judged rotation to be greater when either simulated depth or simulated rotation increased (experiment 4). The results are consistent with a heuristic analysis in which perceived depth is determined by relative motion.

[1]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[2]  J. T. Petersik Perception of three-dimensional angular rotation , 1991, Perception & psychophysics.

[3]  S. Ullman Recent Computational Studies in the Interpretation of Structure from Motion , 1983 .

[4]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[5]  J S Lappin,et al.  Detection of three-dimensional structure in moving optical patterns. , 1984, Journal of experimental psychology. Human perception and performance.

[6]  J. Koenderink,et al.  Exterospecific component of the motion parallax field. , 1981, Journal of the Optical Society of America.

[7]  Myron L. Braunstein,et al.  Depth perception through motion , 1976 .

[8]  D D Hoffman,et al.  Structure from two orthographic views of rigid motion. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[9]  M. Kaiser Angular velocity discrimination , 1990, Perception & psychophysics.

[10]  E Börjesson,et al.  Motion structure in five-dot patterns as a determinant of perceptual grouping , 1993, Perception & psychophysics.

[11]  J T Todd,et al.  The perception of 3-dimensional affine structure from minimal apparent motion sequences , 1990, Perception & psychophysics.

[12]  J. Koenderink,et al.  Visual processing of rotary motion , 1991, Perception & psychophysics.

[13]  D. Proffitt,et al.  Depth perception in motion parallax and stereokinesis. , 1993, Journal of experimental psychology. Human perception and performance.

[14]  David W. Eby,et al.  Perceiving Structure From Motion: Failure Of Shape Constancy , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[15]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[16]  J T Todd,et al.  The perceptual analysis of structure from motion for rotating objects undergoing affine stretching transformations , 1993, Perception & psychophysics.

[17]  J T Todd,et al.  Apparent rotation in three-dimensional space: Effects of temporal, spatial, and structural factors , 1988, Perception & psychophysics.

[18]  David W. Eby,et al.  Relative motion parallax and the perception of structure from motion , 1989, [1989] Proceedings. Workshop on Visual Motion.

[19]  J T Todd,et al.  The visual perception of smoothly curved surfaces from minimal apparent motion sequences , 1991, Perception & psychophysics.

[20]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  M. Kaiser,et al.  Factors influencing perceived angular velocity , 1991, Perception & psychophysics.

[22]  Donald D. Hoffman Inferring local surface orientation from motion fields. , 1982, Journal of the Optical Society of America.

[23]  J S Lappin,et al.  Minimal conditions for the visual detection of structure and motion in three dimensions. , 1980, Science.

[24]  Erik Börjesson,et al.  A vector model for perceived object rotation and translation in space , 1975, Psychological research.

[25]  G. Johansson On theories for visual space perception. A letter to Gibson. , 1970, Scandinavian journal of psychology.

[26]  Donald D. Hoffman,et al.  Discriminating rigid from nonrigid motion: Minimum points and views , 1990, Perception & psychophysics.

[27]  D R Proffitt,et al.  Stereokinetic effect and its relation to the kinetic depth effect. , 1992, Journal of experimental psychology. Human perception and performance.

[28]  Donald D. Hoffman,et al.  Inferring the relative three-dimensional positions of two moving points. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  Donald D. Hoffman,et al.  Minimum points and views for the recovery of three-dimensional structure. , 1987, Journal of experimental psychology. Human perception and performance.

[30]  Thomas S. Huang,et al.  Motion and Structure from Orthographic Projections , 1989, IEEE Trans. Pattern Anal. Mach. Intell..