Neural Models of Motion Perception

Apparent motion (AM) involves two or more “frames” of images, where elements are displaced from frame to frame to elicit the percept of motion. An important question is how a certain element, or feature, is matched across frames to yield the veridical motion percept without false target localization. This is known as the “correspondence problem” (Julesz, 1968; Ullman, 1979). One possibility is that bottom-up, hard-wired neural mechanisms compute motion automatically, without solving explicitly the correspondence problem. At the other extreme top-down motion-tuned mechanisms can first extract specific features of moving objects (such as edges, corners, etc.) and then track these features from one frame to the next to achieve a solution to the correspondence problem. It is quite possible that a wide variety of motion sensing units exist in the visual system, covering the entire spectrum that is defined between the two extremes outlined above. Neural mechanisms that are tuned to a specific direction of motion have been found in the striate cortex, as well as in the extrastriate areas, such as area V5, otherwise known as MT (middle temporal), and area MST (medial superior temporal) (Tovee, 1996).

[1]  Jan J. Koenderink,et al.  Metrics for the strength of low-level motion perception , 1990, J. Vis. Commun. Image Represent..

[2]  L M Vaina,et al.  A lesion of cortical area V2 selectively impairs the perception of the direction of first‐order visual motion , 2000, Neuroreport.

[3]  T D Albright,et al.  What happens if it changes color when it moves?: the nature of chromatic input to macaque visual area MT , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  B. Julesz,et al.  Differences between monocular and binocular stroboscopic movement perception. , 1968, Vision research.

[5]  B. Julesz,et al.  A unified approach to the perception of motion, stereo, and static-flow patterns , 1995 .

[6]  Thomas V. Papathomas,et al.  Double opponency as a generalized concept in texture segregation illustrated with stimuli defined by color, luminance, and orientation , 1993 .

[7]  Andrei Gorea,et al.  Two carriers for motion perception: Color and luminance , 1991, Vision Research.

[8]  Thomas V. Papathomas,et al.  Unified computational model for Fourier and non-Fourier motion , 1996, Proceedings of the IEEE 22nd Annual Northeast Bioengineering Conference.

[9]  John H. R. Maunsell,et al.  How parallel are the primate visual pathways? , 1993, Annual review of neuroscience.

[10]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[11]  Christopher Bowd,et al.  Properties of the stereoscopic (Cyclopean) motion aftereffect , 1994, Vision Research.

[12]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[13]  G. Sperling,et al.  The functional architecture of human visual motion perception , 1995, Vision Research.

[14]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[15]  N. Logothetis,et al.  Role of the color-opponent and broad-band channels in vision , 1990, Visual Neuroscience.

[16]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  Andrew M. Derrington,et al.  Rapid colour-specific detection of motion in human vision , 1996, Nature.

[18]  D. Heeger Nonlinear model of neural responses in cat visual cortex. , 1991 .

[19]  Paul R. Schrater,et al.  Mechanisms of visual motion detection , 2000, Nature Neuroscience.

[20]  B. Julesz Binocular depth perception of computer-generated patterns , 1960 .

[21]  THOMAS V. PAPATHOMAS,et al.  Precise Assessment of the Mean Effective Luminance of Texture Patches—An Approach Based on Reverse-phi Motion , 1996, Vision Research.

[22]  M. Tovée,et al.  An Introduction to the Visual System , 1997 .

[23]  Walter F. Bischof,et al.  Beyond the displacement limit: An analysis of short-range processes in apparent motion , 1985, Vision Research.

[24]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[25]  G. Sperling,et al.  The dimensionality of texture-defined motion: a single channel theory , 1993, Vision Research.

[26]  Alexander Grunewald,et al.  Orthogonal motion after-effect illusion predicted by a model of cortical motion processing , 1996, Nature.

[27]  H R Wilson,et al.  A model for motion coherence and transparency , 1994, Visual Neuroscience.

[28]  G. Sperling,et al.  Second-order motion perception: space/time separable mechanisms , 1989, [1989] Proceedings. Workshop on Visual Motion.

[29]  Stuart Anstis,et al.  The contribution of color to motion in normal and color-deficient observers , 1991, Vision Research.

[30]  Thomas V. Papathomas,et al.  Motion perception with spatiotemporally matched chromatic and achromatic information reveals a “slow” and a “fast” motion system , 1993, Vision Research.

[31]  H. B. Barlow,et al.  Reconstructing the visual image in space and time , 1979, Nature.

[32]  Dimitris N. Metaxas,et al.  The integration of optical flow and deformable models with applications to human face shape and motion estimation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[34]  G. Sperling,et al.  Texture quilts: Basic tools for studying motion-from-texture , 1991 .

[35]  R Blake,et al.  Another perspective on the visual motion aftereffect. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Frans A. J. Verstraten,et al.  The Motion Aftereffect:A Modern Perspective , 1998 .

[37]  Dimitris N. Metaxas,et al.  Optical Flow Constraints on Deformable Models with Applications to Face Tracking , 2000, International Journal of Computer Vision.

[38]  G Sperling,et al.  Measuring the amplification of attention. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[40]  Colin W. G. Clifford,et al.  PII: S0042-6989(98)00082-0 , 1998 .

[41]  Frans A. J. Verstraten,et al.  Movement aftereffect of bi-vectorial transparent motion , 1994, Vision Research.

[42]  T. Albright,et al.  Motion coherency rules are form-cue invariant , 1992, Vision Research.

[43]  A. Cowey,et al.  Perception of first‐ and second‐order motion: Separable neurological mechanisms? , 1999, Human brain mapping.

[44]  D. Teller,et al.  Motion at isoluminance: motion dead zones in three-dimensional color space. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[45]  A. Cowey,et al.  The selective impairment of the perception of first-order motion by unilateral cortical brain damage , 1998, Visual Neuroscience.

[46]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[47]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[48]  Thomas V. Papathomas,et al.  See how they turn: false depth and motion in Hughes's reverspectives , 2000, Electronic Imaging.

[49]  G. Sperling Three stages and two systems of visual processing. , 1989, Spatial vision.

[50]  Tatsuto Takeuchi,et al.  The effects of luminance on affinity of apparent motion , 1990, Vision Research.

[51]  H. Barlow,et al.  Evidence for a Physiological Explanation of the Waterfall Phenomenon and Figural After-effects , 1963, Nature.

[52]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[53]  P. Cavanagh,et al.  Motion: the long and short of it. , 1989, Spatial vision.

[54]  J. Krauskopf,et al.  Influence of colour on the perception of coherent motion , 1990, Nature.

[55]  E. Adelson,et al.  Directionally selective complex cells and the computation of motion energy in cat visual cortex , 1992, Vision Research.

[56]  D. C. Van Essen,et al.  Concurrent processing streams in monkey visual cortex , 1988, Trends in Neurosciences.

[57]  Luis A. Lesmes,et al.  The mechanism of isoluminant chromatic motion perception. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[58]  P. McOwan,et al.  A computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[59]  A. Cowey,et al.  Impairment of the perception of second order motion but not first order motion in a patient with unilateral focal brain damage , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[60]  A Gorea,et al.  Two motion systems with common and separate pathways for color and luminance. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[61]  V. S. RAMACHANDRAN,et al.  Does colour provide an input to human motion perception? , 1978, Nature.

[62]  S. Anstis,et al.  Phi movement as a subtraction process. , 1970, Vision research.

[63]  W. H. Ittelson,et al.  Experiments in Perception , 1951 .

[64]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[65]  V. Bruce,et al.  Visual Perception: Physiology, Psychology and Ecology , 1985 .

[66]  Jochen Braun Targeting visual motion , 2000, Nature Neuroscience.

[67]  E. Mingolla,et al.  Motion after-effect due to binocular sum of adaptation to linear motion , 1998, Vision Research.

[68]  G. Mather The Movement Aftereffect and a Distribution-Shift Model for Coding the Direction of Visual Movement , 1980, Perception.

[69]  O E Favreau,et al.  Perceived velocity of moving chromatic gratings. , 1984, Journal of the Optical Society of America. A, Optics and image science.