Computing visual motion in the short and the long: from receptive fields to neural networks

Theoretical approaches to the study of perceptual phenomena of short-range and long-range apparent motion are discussed. Short-range motion is estimated by real-time receptive fields sensitive to velocities of image features. The design of these receptive fields follows from the concept of convected activation profiles, where shape-preserving activity waves are excited by, and ride atop, dynamic features. Long-range motion concerns the correspondence between features in disparate images, and the perceptual impletion of a path between these corresponding features. It is argued that this illusory motion is an artifact of a more general spatiotemporal grouping process. This process is realized in a dynamic nonlinear feedback neural network that is called a neural analog diffusion-enhancement layer (NADEL). Computations suggest that the NADEL can support a variety of long-range motion percepts popularized by the Gestalt psychologists. The authors illustrate (on videotape) both classes of computation in real time on the PIPE parallel computer.<<ETX>>

[1]  Eric L. Schwartz,et al.  Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding , 1980, Vision Research.

[2]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985 .

[3]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  B G Breitmeyer,et al.  A relationship between the detection of size, rate, orientation and direction in the human visual system. , 1973, Vision research.

[6]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  J T Todd,et al.  Apparent rotation in three-dimensional space: Effects of temporal, spatial, and structural factors , 1988, Perception & psychophysics.

[8]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[9]  Allen M. Waxman,et al.  Convected activation profiles and the measurement of visual motion , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  S. Anstis The perception of apparent movement. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  F. Kaufmann,et al.  Aspects of Motion Perception in Infancy , 1987 .

[12]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[14]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .

[16]  D. Puro The Retina. An Approachable Part of the Brain , 1988 .

[17]  Robert K. Cunningham,et al.  The Neural Analog Diffusion-Enhancement Layer (NADEL) And Early Visual Processing , 1988, Other Conferences.

[18]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[19]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[20]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[21]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[22]  Ciro Cafforio,et al.  Methods for measuring small displacements of television images , 1976, IEEE Trans. Inf. Theory.

[23]  D. C. Van Essen,et al.  Concurrent processing streams in monkey visual cortex , 1988, Trends in Neurosciences.

[24]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[25]  H. Barlow,et al.  Retinal ganglion cells responding selectively to direction and speed of image motion in the rabbit , 1964, The Journal of physiology.

[26]  S Grossberg,et al.  Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks. , 1975, Journal of theoretical biology.

[27]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[28]  Allen M. Waxman,et al.  Spreading activation layers, visual saccades, and invariant representations for neural pattern recognition systems , 1989, Neural Networks.

[29]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[30]  Stephen Grossberg,et al.  Contour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks , 1973 .

[31]  G. Orban Velocity Tuned Cortical Cells and Human Velocity Discrimination , 1985 .

[32]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .