Perceptual motion transparency : the role of geometrical information

Perceptual motion transparency occurs whenever two or more patterns are seen moving at different depth levels, such that we can see one pattern move across the others, and perceptual motion coherence occurs when we see a single motion. We present here a model of perceptual motion transparency and coherence that consists of three stages: (i) measure the normal velocity along contours or the velocity of features such as corners or line end points; (ii) take the intersection, in velocity space, of all possible pairs of constraint lines associated with the normal velocity components; and (iii) combine the results of steps (i) and (ii) in the velocity histogram, which is the plot of the total number of votes for each velocity in velocity space. For two patterns we perceive motion coherence, transparency, or a mixture of both types of motion depending on whether the velocity histogram is unimodal, bimodal, or trimodal. According to our model we perceive motion transparency or coherence depending on the total number of prominent peaks of the velocity histogram, where each peak is located at the position corresponding to the velocity of one of the patterns or of coherent motion. We show that the number of prominent peaks in the velocity histogram depends on the error in the measurement of the local velocity and on the relative orientation of the local velocities along contours; this relative orientation encodes contour shape. Our model differs from current motion theories in that it describes the perception of motion not as a result of local velocity extraction but instead as the result of the integration of local velocity and geometrical shape information across different points of the image and across superimposed patterns. This model allows for the occurrence of mixed motion perception, which arises from the combination of the velocity information associated with motion transparency and coherence. We have tested this model through computational and psychophysical experiments done with line patterns. As a result of these experiments we conjecture that the human visual system may use at least three stages to process image velocity.

[1]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[2]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[3]  A. Rosenfeld,et al.  Edge and Curve Detection for Visual Scene Analysis , 1971, IEEE Transactions on Computers.

[4]  J. Movshon The velocity tuning of single units in cat striate cortex. , 1975, The Journal of physiology.

[5]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[6]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[7]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[10]  Kent A. Stevens,et al.  The Visual Interpretation of Surface Contours , 1981, Artif. Intell..

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[13]  Alan L. Yuille,et al.  An Extremum Principle for Shape from Contour , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Richard I. Ivry,et al.  The perception of transparency with achromatic colors , 1984, Perception & psychophysics.

[15]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[16]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[18]  F. Metelli Stimulation and perception of transparency , 1985, Psychological research.

[19]  Ken Nakayama,et al.  Biological image motion processing: A review , 1985, Vision Research.

[20]  Isaac Weiss 3-D Shape Representation by Contours , 1985, IJCAI.

[21]  David J. Fleet,et al.  Spatiotemporal inseparability in early vision: centre‐surround models and velocity selectivity , 1985 .

[22]  Alan L. Yuille,et al.  Scaling Theorems for Zero Crossings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. , 1986, Journal of neurophysiology.

[24]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[26]  K. Nakayama,et al.  The aperture problem—I. Perception of nonrigidity and motion direction in translating sinusoidal lines , 1988, Vision Research.

[27]  Norberto M. Grzywacz,et al.  A computational theory for the perception of coherent visual motion , 1988, Nature.

[28]  T. Poggio,et al.  A parallel algorithm for real-time computation of optical flow , 1989, Nature.

[29]  Leslie Welch,et al.  The perception of moving plaids reveals two motion-processing stages , 1989, Nature.

[30]  Brian G. Schunck,et al.  Image Flow Segmentation and Estimation by Constraint Line Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Daphna Weinshall,et al.  Perception of multiple transparent planes in stereo vision , 1989, Nature.

[32]  John P. Frisby,et al.  Transparency and the uniqueness constraint in human and computer stereo vision , 1990, Nature.

[33]  T. D. Albright,et al.  Transparency and coherence in human motion perception , 1990, Nature.

[34]  J. Krauskopf,et al.  Influence of colour on the perception of coherent motion , 1990, Nature.

[35]  V. Ramachandran,et al.  Transparency: Relation to Depth, Subjective Contours, Luminance, and Neon Color Spreading , 1990, Perception.

[36]  Thomas D. Albright,et al.  Color and the integration of motion signals , 1991, Trends in Neurosciences.