Stereo-motion cooperation and the use ofmotion disparity in the visual perception of 3-D structure

When an observer views a moving scene binocularly, both motion parallax and binocular disparity provide depth information. In Experiments lA-1C, we measured sensitivity to surface curvature when these depth cues were available either individually or simultaneously. When the depth cues yielded comparable sensitivity to surface curvature, we found that curvature detection was easier with the cues present simultaneously, rather than individually. For 2 of the 6 subjects, this effect was stronger when the component of frontal translation of the surface was vertical, rather than horizontal. No such anisotropy was found for the 4 other subjects. If a moving object is observed binocularly, the patterns of optic flow are different on the left and right retinae. We have suggested elsewhere (Cornilleau-Pérès & Droulez, in press) that this motion disparity might be used as avisual cue for the perception of a 3-D structure. Our model consisted in deriving binocular disparity from the left and right distributions of vertical velocities, rather than from luminous intensities, as has been done in classical studies on stereoscopic vision. The model led to some predictions concerning the detection of surface curvature from motion disparity in the presence or absence of intensity-based disparity (classically termedbinocular disparity). In a second set of experiments, we attempted to test these predictions, and we failed to validate our theoretical scheme from a physiological point of view.

[1]  M. Cynader,et al.  Neurones in cat parastriate cortex sensitive to the direction of motion in three‐dimensional space , 1978, The Journal of physiology.

[2]  M. Braunstein,et al.  Recovering viewer-centered depth from disparity, occlusion, and velocity gradients , 1986, Perception & psychophysics.

[3]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  J. T. Petersik,et al.  The Effects of Spatial and Temporal Factors on the Perception of Stroboscopic Rotation Simulations , 1980, Perception.

[5]  S. Zeki Cells responding to changing image size and disparity in the cortex of the rhesus monkey , 1974, The Journal of physiology.

[6]  Ken Nakayama,et al.  Biological image motion processing: A review , 1985, Vision Research.

[7]  Allen M. Waxman,et al.  Surface Structure and Three-Dimensional Motion from Image Flow Kinematics , 1985 .

[8]  E. Hildreth The computation of the velocity field , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  J. Pokorny Foundations of Cyclopean Perception , 1972 .

[10]  Vision Research , 1961, Nature.

[11]  Amar Mitiche,et al.  Three-dimensional space from optical flow correspondence , 1988, Comput. Vis. Graph. Image Process..

[12]  G. W. PETTIGREW,et al.  The Amino-acid Sequence of Cytochrome c from Euglena gracilis , 1973, Nature.

[13]  G. Poggio,et al.  Mechanisms of static and dynamic stereopsis in foveal cortex of the rhesus monkey , 1981, The Journal of physiology.

[14]  S. McKee,et al.  Steroscopic acuity for moving retinal images. , 1978, Journal of the Optical Society of America.

[15]  Stefan Treue,et al.  Surface Interpolation in Three-Dimensional Structure-from-Motion Perception , 1989, Neural Computation.

[16]  D. Regan,et al.  Neurons in cat visual cortex tuned to the direction of motion in depth: Effect of positional disparity , 1982, Vision Research.

[17]  Allen Brookes,et al.  Integrating stereopsis with monocular interpretations of planar surfaces , 1988, Vision Research.

[18]  J. Pettigrew Binocular Neurones which signal Change of Disparity in Area 18 of Cat Visual Cortex , 1973 .

[19]  D Regan,et al.  A stereo field map with implications for disparity processing. , 1973, Investigative ophthalmology.

[20]  W C Gogel,et al.  The sensing of retinal motion , 1980, Perception & psychophysics.

[21]  W Richards,et al.  Structure from stereo and motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[22]  T. Marill Detection theory and psychophysics , 1956 .

[23]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[24]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[25]  David N. Lee,et al.  Binocular stereopsis without spatial disparity , 1971 .

[26]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  K. Toyama,et al.  Responses of clare-bishop neurones to three dimensional movement of a light stimulus , 1982, Vision Research.

[28]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[29]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[30]  G Sperling,et al.  Kinetic depth effect and identification of shape. , 1989, Journal of experimental psychology. Human perception and performance.

[31]  John M. Foley,et al.  Primary Distance Perception , 1978 .

[32]  R. Blake,et al.  The interplay between stereopsis and structure from motion , 1991, Perception & psychophysics.

[33]  E. Bradbury,et al.  Magnetic Resonance Studies of Deoxyribonucleoprotein , 1973, Nature.

[34]  Robert Fox,et al.  The psychophysical inquiry into binocular summation , 1973 .

[35]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[36]  Lynn A. Olzak,et al.  Cue summation in spatial discriminations , 1990, Vision Research.

[37]  D Regan,et al.  The dissociation of sideways movements from movements in depth: psychophysics. , 1973, Vision research.

[38]  Jacques Droulez,et al.  Stereo Correspondence From Optic Flow , 1990, ECCV.

[39]  B. Rogers,et al.  Similarities between motion parallax and stereopsis in human depth perception , 1982, Vision Research.

[40]  G. Westheimer,et al.  Depth attraction and repulsion of disparate foveal stimuli , 1987, Vision Research.

[41]  Yukio Komatsu,et al.  Responsiveness of Clare-Bishop neurons to visual cues associated with motion of a visual stimulus in three-dimensional space , 1985, Vision Research.

[42]  B J Rogers,et al.  The Appearance of Surfaces Specified by Motion Parallax and Binocular Disparity , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[43]  J. Droulez,et al.  Visual perception of surface curvature: Psychophysics of curvature detection induced by motion parallax , 1989, Perception & psychophysics.

[44]  J T Todd,et al.  On the distinction between artifacts and information. , 1990, Journal of experimental psychology. Human perception and performance.

[45]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[46]  H. Bülthoff,et al.  INTERACTION OF DIFFERENT MODULES IN DEPTH PERCEPTION. , 1987, ICCV 1987.

[47]  Maureen Graham,et al.  Motion Parallax and the Perception of Three-Dimensional Surfaces , 1985 .

[48]  D. Regan,et al.  Evidence for the existence of neural mechanisms selectively sensitive to the direction of movement in space , 1973, The Journal of physiology.

[49]  G Sperling,et al.  How to study the kinetic depth effect experimentally. , 1990, Journal of experimental psychology. Human perception and performance.

[50]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.