Temporal covariance model of human motion perception.

We propose a model of direction-sensitive units in human vision. It is a modified and elaborated version of a model by Reichardt [Z. Naturforsch . Teil B 12, 447 (1957)]. The model is applied to threshold experiments in which subjects view adjacent vertical bars with independently (typically sinusoidally), temporally modulated luminances. The subject must report whether the patterns moved to the left or to the right. According to the model, a basic motion-detecting unit consists of two subunits tuned to opposite directions. Each performs a spatial and temporal linear filtering of its input; outputs of the filters are multiplied, and the multiplied output is integrated (for a time that is long relative to the modulation period). The model's output consists of the difference between the subunit outputs. Direction of movement is indicated by the sign of the model output. Mathematical analysis of the model yielded several predictions that were confirmed experimentally. Specifically, we found that (1) performance with complex patterns can be predicted by spatiotemporal Fourier analysis that results in the segregation and linear addition in the output for different temporal frequencies; (2) under special conditions, performance depends on the product of adjacent bar amplitudes, offering strong support for the multiplication principle; (3) performance is unaffected by addition of stationary patterns; and (4) addition of homogeneous flicker normally produces no effect but under special conditions reverses perceived direction. These and other results confirm our model and reject several other models, including Reichardt 's original model.

[1]  Dennis Gabor,et al.  Theory of communication , 1946 .

[2]  W. Reichardt.  Autokorrelations-Auswertung als Funktionsprinzip des Zentralnervensystems , 1957 .

[3]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[4]  J. F. Schouten,et al.  Subjective stroboscopy and a model of visual movement detectors , 1966 .

[5]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[6]  John A. Leese,et al.  The determination of cloud pattern motions from geosynchronous satellite image data , 1970, Pattern Recognit..

[7]  H. D. Brunk,et al.  Statistical inference under order restrictions : the theory and application of isotonic regression , 1973 .

[8]  ERIC A. SMITH,et al.  Automated Cloud Tracking Using Precisely Aligned Digital ATS Pictures , 1972, IEEE Transactions on Computers.

[9]  O. Braddick.  A short-range process in apparent motion. , 1974, Vision research.

[10]  R. Sekuler,et al.  The independence of channels in human vision selective for direction of movement. , 1975, The Journal of physiology.

[11]  S. Anstis,et al.  Illusory reversal of visual depth and movement during changes of contrast , 1975, Vision Research.

[12]  M. Sanders.  Handbook of Sensory Physiology , 1975 .

[13]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .

[14]  A Pantle,et al.  A multistable movement display: evidence for two separate motion systems in human vision. , 1976, Science.

[15]  G. Sperling.  Movement perception in computer-driven visual displays , 1976 .

[16]  Brian J. Murphy,et al.  Pattern thresholds for moving and stationary gratings during smooth eye movement , 1978, Vision Research.

[17]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[18]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[19]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[20]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[21]  Brian J. Murphy,et al.  Summation and discrimination of gratings moving in opposite directions , 1980, Vision Research.

[22]  H. Wilson.  Spatiotemporal characterization of a transient mechanism in the human visual system , 1980, Vision Research.

[23]  J. Daugman.  Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[24]  O J Braddick,et al.  Low-level and high-level processes in apparent motion. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[25]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[26]  J. Loomis.  Transient tritanopia: Failure of time-intensity reciprocity in adaptation to longwave light , 1980, Vision Research.

[27]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  Shimon Ullman,et al.  Analysis of Visual Motion by Biological and Computer Systems , 1981, Computer.

[29]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.

[31]  John B. Goodenough.  The Ada Compiler Validation Capability , 1981 .

[32]  C H Anderson,et al.  Spatially inhomogeneous scaled transforms for vision and pattern recognition. , 1981, Optics letters.

[33]  D. Burr,et al.  Contrast sensitivity at high velocities , 1982, Vision Research.

[34]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .