A psychophysically motivated model for two-dimensional motion perception

A quantitative model is developed to predict the perceived direction of moving two-dimensional patterns. The model incorporates both a simple motion energy pathway and a "texture boundary motion" pathway that incorporates response squaring before the extraction of motion energy. These pathways correspond to Fourier and non-Fourier motion pathways and are hypothesized to reflect processing in the V1-MT and V1-V2-MT pathway, respectively. A cosine-weighted sum of these pathways followed by competitive feedback inhibition accurately predicts the perceived direction for patterns composed of two cosine gratings at different orientations ("plaids"). The model also predicts direction discrimination, differences between foveal and peripheral viewing, changes in perceived direction with exposure duration, motion masking, and motion transparency.

[1]  Hans Wallach.  Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[2]  R. Brubaker.  Models for the perception of speech and visual form: Weiant Wathen-Dunn, ed.: Cambridge, Mass., The M.I.T. Press, I–X, 470 pages , 1968 .

[3]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[4]  J. Movshon.  The velocity tuning of single units in cat striate cortex. , 1975, The Journal of physiology.

[5]  D. Broadbent,et al.  Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency , 1975, Vision Research.

[6]  A Pantle,et al.  A multistable movement display: evidence for two separate motion systems in human vision. , 1976, Science.

[7]  Hugh R. Wilson,et al.  Hysteresis in binocular grating perception: Contrast effects , 1977, Vision Research.

[8]  L A Riggs,et al.  Visual aftereffects derived from inspection of orthogonally moving patterns. , 1980, Science.

[9]  H. Wilson.  Spatiotemporal characterization of a transient mechanism in the human visual system , 1980, Vision Research.

[10]  G. Orban,et al.  Response to movement of neurons in areas 17 and 18 of the cat: velocity sensitivity. , 1981, Journal of neurophysiology.

[11]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[12]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[13]  D. G. Albrecht,et al.  Striate cortex of monkey and cat: contrast response function. , 1982, Journal of neurophysiology.

[14]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[15]  H. Wilson,et al.  Spatial frequency tuning of orientation selective units estimated by oblique masking , 1983, Vision Research.

[16]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[17]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[18]  H. Wilson,et al.  Modified line-element theory for spatial-frequency and width discrimination. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[19]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[20]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[21]  H. Wilson,et al.  Orientation bandwidths of spatial mechanisms measured by masking. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[22]  W. Newsome,et al.  Deficits in visual motion processing following ibotenic acid lesions of the middle temporal visual area of the macaque monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[24]  A. Derrington,et al.  Separate detectors for simple and complex grating patterns? , 1985, Vision Research.

[25]  Charles G. Gross,et al.  Pattern recognition mechanisms , 1985 .

[26]  E. DeYoe,et al.  Segregation of efferent connections and receptive field properties in visual area V2 of the macaque , 1985, Nature.

[27]  J. Bergen,et al.  Prediction of flicker sensitivities from temporal three-pulse data , 1985, Vision Research.

[28]  S. Anstis,et al.  Effects of Luminance and Contrast on Direction of Ambiguous Apparent Motion , 1985, Perception.

[29]  V. Ramachandran,et al.  Spatial phase and frequency in motion capture of random-dot patterns. , 1985, Spatial vision.

[30]  R. Sekuler,et al.  Hysteresis in the perception of motion direction as evidence for neural cooperativity , 1986, Nature.

[31]  V. S. Ramachandran,et al.  Perception of illusory occlusion in apparent motion , 1986, Vision Research.

[32]  G. Phillips,et al.  Cooperative phenomena in the perception of motion direction. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[33]  D. J. Felleman,et al.  Receptive field properties of neurons in area V3 of macaque monkey extrastriate cortex. , 1987, Journal of neurophysiology.

[34]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[35]  Vincent P. Ferrera,et al.  Direction specific masking and the analysis of motion in two dimensions , 1987, Vision Research.

[36]  V. Ramachandran,et al.  Motion capture anisotropy , 1987, Vision Research.

[37]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[38]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[39]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  J. Kaas,et al.  Cortical integration of parallel pathways in the visual system of primates , 1989, Brain Research.

[41]  A. Pantle,et al.  On the mechanism that encodes the movement of contrast variations: Velocity discrimination , 1989, Vision Research.

[42]  G Sperling,et al.  Two motion perception mechanisms revealed through distance-driven reversal of apparent motion. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[43]  L Krubitzer,et al.  Convergence of processing channels in the extrastriate cortex of monkeys , 1990, Visual Neuroscience.

[44]  T. Nealey,et al.  Magnocellular and parvocellular contributions to responses in the middle temporal visual area (MT) of the macaque monkey , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[46]  John A. Perrone,et al.  Simple technique for optical flow estimation , 1990 .

[47]  H. Wilson,et al.  Perceived direction of moving two-dimensional patterns , 1990, Vision Research.

[48]  R. Sekuler,et al.  Assimilation and contrast in motion perception: Explorations in cooperativity , 1990, Vision Research.

[49]  J. B. Mulligan,et al.  Effect of contrast on the perceived direction of a moving plaid , 1990, Vision Research.

[50]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[51]  R A Andersen,et al.  The response of area MT and V1 neurons to transparent motion , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  Manuel Suero,et al.  Motion of complex patterns is computed from the perceived motions of their components , 1991, Vision Research.

[53]  S. Grossberg.  Why do parallel cortical systems exist for the perception of static form and moving form? , 1991, Perception & psychophysics.

[54]  D. G. Albrecht,et al.  Motion selectivity and the contrast-response function of simple cells in the visual cortex , 1991, Visual Neuroscience.

[55]  K. Turano.  Evidence for a Common Motion Mechanism of Luminance-Modulated and Contrast-Modulated Patterns: Selective Adaptation , 1991, Perception.

[56]  J. Bergen,et al.  Texture segregation and orientation gradient , 1991, Vision Research.

[57]  Vincent P. Ferrera,et al.  Perceived speed of moving two-dimensional patterns , 1991, Vision Research.

[58]  E. Adelson,et al.  Directionally selective complex cells and the computation of motion energy in cat visual cortex , 1992, Vision Research.

[59]  R. Blake,et al.  Misdirected visual motion in the peripheral visual field , 1992, Vision Research.

[60]  H. Wilson,et al.  Moving two-dimensional patterns can capture the perceived directions of lower or higher spatial frequency gratings , 1992, Vision Research.

[61]  H R Wilson,et al.  Curvature and separation discrimination at texture boundaries. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[62]  Hugh R. Wilson,et al.  Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity , 1992, Vision Research.

[63]  Hugh R. Wilson,et al.  Illusory motion of texture boundaries , 1993, Vision Research.