Spatiotemporal energy models for the perception of motion.

A motion sequence may be represented as a single pattern in x-y-t space; a velocity of motion corresponds to a three-dimensional orientation in this space. Motion sinformation can be extracted by a system that responds to the oriented spatiotemporal energy. We discuss a class of models for human motion mechanisms in which the first stage consists of linear filters that are oriented in space-time and tuned in spatial frequency. The outputs of quadrature pairs of such filters are squared and summed to give a measure of motion energy. These responses are then fed into an opponent stage. Energy models can be built from elements that are consistent with known physiology and psychophysics, and they permit a qualitative understanding of a variety of motion phenomena.

[1]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[2]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[3]  J. Robson.  Spatial and Temporal Contrast-Sensitivity Functions of the Visual System , 1966 .

[4]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[5]  L. Rask.  ON APPARENT MOVEMENT , 1967 .

[6]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[7]  R Sekuler,et al.  Contrast response of human visual mechanismsensitive to orientation and direction of motion. , 1969, Vision research.

[8]  J. Lappin,et al.  Perceptual differentiation of sequential visual patterns , 1972 .

[9]  O. Braddick.  A short-range process in apparent motion. , 1974, Vision research.

[10]  R. Sekuler,et al.  The independence of channels in human vision selective for direction of movement. , 1975, The Journal of physiology.

[11]  D. E. Pearson,et al.  Transmission and display of pictorial information , 1975 .

[12]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of striate cortical neurones , 1975, Nature.

[13]  S. Anstis,et al.  Illusory reversal of visual depth and movement during changes of contrast , 1975, Vision Research.

[14]  M. Sanders.  Handbook of Sensory Physiology , 1975 .

[15]  D. Tolhurst.  Sustained and transient channels in human vision , 1975, Vision Research.

[16]  A Pantle,et al.  A multistable movement display: evidence for two separate motion systems in human vision. , 1976, Science.

[17]  G. Sperling.  Movement perception in computer-driven visual displays , 1976 .

[18]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[19]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[20]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[21]  M. Morgan,et al.  Perception of continuity in stroboscopic motion: A temporal frequency analysis , 1979, Vision Research.

[22]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[23]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[24]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[25]  S. Anstis.  The perception of apparent movement. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Brian J. Murphy,et al.  Summation and discrimination of gratings moving in opposite directions , 1980, Vision Research.

[27]  M J Morgan,et al.  Analogue models of motion perception. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[28]  O J Braddick,et al.  Low-level and high-level processes in apparent motion. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[29]  Edward H. Adelson,et al.  Phenomenal coherence of moving gratings (A) , 1980 .

[30]  T. Poggio,et al.  Visual hyperacuity: spatiotemporal interpolation in human vision , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[31]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[32]  P. Burt,et al.  Time, distance, and feature trade-offs in visual apparent motion. , 1981, Psychological review.

[33]  J. Robson,et al.  Discrimination at threshold: Labelled detectors in human vision , 1981, Vision Research.

[34]  P. Thompson.  Perceived rate of movement depends on contrast , 1982, Vision Research.

[35]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[36]  T. S. Robson.  Extended-definition television service , 1982 .

[37]  P. Ransom,et al.  Measured characteristic curves of the liquid-crystal light valve (A) , 1983 .

[38]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[39]  S. Klein,et al.  Opponent-movement mechanisms in human vision. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[40]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[41]  Peter Thompson,et al.  The coding of velocity of movement in the human visual system , 1984, Vision Research.

[42]  J. Bergen,et al.  Prediction of flicker sensitivities from temporal three-pulse data , 1985, Vision Research.

[43]  Andrew B. Watson,et al.  Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displays , 1986 .