Interaction between Transparency and Structure from Motion

It is well known that the human visual system can reconstruct depth from simple random-dot displays given binocular disparity or motion information. This fact has lent support to the notion that stereo and structure from motion systems rely on low-level primitives derived from image intensities. In contrast, the judgment of surface transparency is often considered to be a higher-level visual process that, in addition to pictorial cues, utilizes stereo and motion information to separate the transparent from the opaque parts. We describe a new illusion and present psychophysical results that question this sequential view by showing that depth from transparency and opacity can override the bias to see rigid motion. The brain's computation of transparency may involve a two-way interaction with the computation of structure from motion.

[1]  M Nawrot,et al.  Neural integration of information specifying structure from stereopsis and motion. , 1989, Science.

[2]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[3]  M Nawrot,et al.  A neural network model of kinetic depth , 1991, Visual Neuroscience.

[4]  S. Ullman.  The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[5]  Richard I. Ivry,et al.  The perception of transparency with achromatic colors , 1984, Perception & psychophysics.

[6]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[9]  J. Aggarwal,et al.  Motion Understanding: Robot and Human Vision , 1988 .

[10]  M. Landy,et al.  Transparency and the Cooperative Computation of Scene Attributes , 1991 .

[11]  Shinsuke Shimojo,et al.  Transparency: Relation to depth, subjective contours and color spreading , 1990 .

[12]  J. A. Anderson,et al.  A neural network model of multistable perception. , 1985, Acta psychologica.

[13]  A. Gilchrist.  Perceived lightness depends on perceived spatial arrangement. , 1977, Science.

[14]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[15]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[16]  J Allman,et al.  Direction- and Velocity-Specific Responses from beyond the Classical Receptive Field in the Middle Temporal Visual Area (MT) , 1985, Perception.

[17]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[18]  Hermann Haken,et al.  Oscillations in the Perception of Ambiguous Patterns , 1991 .

[19]  K Nakayama,et al.  Toward a neural understanding of visual surface representation. , 1990, Cold Spring Harbor symposia on quantitative biology.

[20]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[21]  G. Sperling,et al.  Tradeoffs between stereopsis and proximity luminance covariance as determinants of perceived 3D structure , 1986, Vision Research.

[22]  T. Albright,et al.  Image Segmentation Cues in Motion Processing: Implications for Modularity in Vision , 1993, Journal of Cognitive Neuroscience.

[23]  Allan D. Jepson,et al.  A lattice framework for integrating vision modules , 1992, IEEE Trans. Syst. Man Cybern..

[24]  Heinrich H. Bülthoff,et al.  Bayesian Models for Seeing Shapes and Depth , 1990 .

[25]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[26]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  R A Andersen,et al.  The response of area MT and V1 neurons to transparent motion , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Daniel J. Kersten,et al.  Reflectance estimation in the presence of sharp shadows or transparency , 1988, Neural Networks.

[29]  Michael S. Landy,et al.  A Statistical Framework for Robust Fusion of Depth Information , 1989, Other Conferences.

[30]  J. P. Cavanagh,et al.  Reconstructing the third dimension: Interactions between color, texture, motion, binocular disparity, and shape , 1987, Comput. Vis. Graph. Image Process..

[31]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[32]  T. D. Albright,et al.  Transparency and coherence in human motion perception , 1990, Nature.

[33]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[34]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[35]  D. Kersten.  Transparency and the cooperative computation of scene attributes , 1991 .

[36]  T Poggio,et al.  Parallel integration of vision modules. , 1988, Science.

[37]  P. Cavanagh,et al.  Subjective contours capture stereopsis , 1985, Nature.

[38]  S. Zeki.  Functional specialisation in the visual cortex of the rhesus monkey , 1978, Nature.

[39]  K. Nakayama,et al.  Occlusion and the solution to the aperture problem for motion , 1989, Vision Research.

[40]  Whitman Richards,et al.  Efficient Computations and Representations of Visible Surfaces. , 1979 .

[41]  Daniel Kersten,et al.  Apparent Opacity Affects Perception of Structure from Motion and Stereo , 1989 .