The response of area MT and V1 neurons to transparent motion

An important use of motion information is to segment a complex visual scene into surfaces and objects. Transparent motions present a particularly difficult problem for segmentation because more than one velocity vector occurs at each local region in the image, and current machine vision systems fail in these circumstances. The fact that motion transparency is prevalent in natural scenes, and yet artificial systems display an inability to analyze it, suggests that the primate visual system has developed specialized methods for perceiving transparent motion. Also, the currently prevalent model of physiological mechanisms for motion-direction selectivity employs inhibitory interactions between neurons; such interactions would silence neurons under transparent conditions and render the visual system blind to transparent motion. To examine how the primate visual system solves this transparency problem, we recorded the activity of direction-selective cells in the first (area V1) and in a later (area MT) stage in the cortical motion-processing pathway in behaving monkeys. The visual stimuli consisted of random dot patterns forming single moving surfaces, transparent surfaces, and motion discontinuities. We found that area V1 cells responded to their preferred direction of movement even under transparent conditions, whereas area MT cells were suppressed under the transparent condition. These data suggest a simple solution to the transparency problem at the level of area V1. More than one motion vector can be represented at a single retinal location by different subpopulations of neurons tuned to different directions of motion; these subpopulations may represent the early stage for segmenting different, transparent surfaces. The results also suggest that facilitatory mechanisms, which unlike inhibitory interactions are largely unaffected by transparent conditions, play an important role in direction selectivity in area V1. The inhibitory interactions for different motion directions for area MT neurons may contribute to a mechanism for smoothing or averaging the velocity field, computations thought to be necessary for reducing noise and interpolating moving surfaces from sparse information.

[1]  T. Poggio,et al.  Synapses that compute motion. , 1987, Scientific American.

[2]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[3]  R. Snowden Suppressive interactions between moving patterns: Role of velocity , 1990, Perception & psychophysics.

[4]  R. M. Siegel,et al.  Perception of three-dimensional structure from motion in monkey and man , 1988, Nature.

[5]  G. Henry,et al.  Direction selectivity of complex cells in a comparison with simple cells. , 1975, Journal of neurophysiology.

[6]  C. Gross,et al.  Visual topography of striate projection zone (MT) in posterior superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[7]  S. Klein,et al.  Opponent-movement mechanisms in human vision. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[8]  C. W. Oyster,et al.  Rabbit Lateral Geniculate Nucleus: Sharpener of Directional Information , 1969, Science.

[9]  R. Freeman,et al.  A comparison of inhibition in orientation and spatial frequency selectivity of cat visual cortex , 1986, Nature.

[10]  J. Simpson,et al.  SPASTICITY: MECHANISM, MEASUREMENT, MANAGEMENT , 1970 .

[11]  Tomaso Poggio,et al.  Computations in the vertebrate retina: gain enhancement, differentiation and motion discrimination , 1986, Trends in Neurosciences.

[12]  K. Krnjević,et al.  Chemical Nature of Synaptic Transmission in Vertebrates , 1974 .

[13]  D. Whitteridge,et al.  Selective responses of visual cortical cells do not depend on shunting inhibition , 1988, Nature.

[14]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  J. E. Albano,et al.  The role of directionally selective neurons in the perception of global motion , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  R. Sekuler,et al.  Hysteresis in the perception of motion direction as evidence for neural cooperativity , 1986, Nature.

[17]  Norberto M. Grzywacz,et al.  A computational theory for the perception of coherent visual motion , 1988, Nature.

[18]  R. Sekuler,et al.  Mutual repulsion between moving visual targets. , 1979, Science.

[19]  S. Shipp,et al.  SEGREGATED OUTPUT TO AREA V5 FROM LAYER 4B OF MACAQUE MONKEY STRIATE CORTEX , 1985 .

[20]  Shigeru Yamane,et al.  Neural interactions of two slits in the orientation domain in the visual cortical units of the cat , 1983, Vision Research.

[21]  B. Julesz,et al.  Cooperative phenomena in apparent movement perception of random-dot cinematograms , 1984, Vision Research.

[22]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Alan L. Yuille,et al.  A Winner-Take-All Mechanism Based on Presynaptic Inhibition Feedback , 1989, Neural Computation.

[24]  Robert Jefferson Snowden,et al.  Motions in orthogonal directions are mutually suppressive , 1989 .

[25]  Curtis L. Baker,et al.  Eccentricity-dependent scaling of the limits for short-range apparent motion perception , 1985, Vision Research.

[26]  A. Sillito Inhibitory processes underlying the directional specificity of simple, complex and hypercomplex cells in the cat's visual cortex , 1977, The Journal of physiology.

[27]  L. Fogassi,et al.  Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Alexander Borst,et al.  The role of GABA in detecting visual motion , 1990, Brain Research.

[29]  H. Barlow,et al.  Retinal ganglion cells responding selectively to direction and speed of image motion in the rabbit , 1964, The Journal of physiology.

[30]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[31]  Jin Luo,et al.  Computing motion using analog and binary resistive networks , 1988, Computer.

[32]  T. Poggio,et al.  A parallel algorithm for real-time computation of optical flow , 1989, Nature.

[33]  Stefan Treue,et al.  Human perception of structure from motion , 1991, Vision Research.

[34]  Robert J. Snowden,et al.  Differences in the processing of short-range apparent motion at small and large displacements , 1990, Vision Research.

[35]  Christof Koch,et al.  Computing Optical Flow in the Primate Visual System , 1989, Neural Computation.

[36]  Eileen Kowler,et al.  Voluntary selection of the target for smooth eye movement in the presence of superimposed, full-field stationary and moving stimuli , 1984, Vision Research.

[37]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[38]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  P. O. Bishop,et al.  Direction selectivity of simple striate cells: properties and mechanism. , 1975, Journal of neurophysiology.

[40]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. , 1986, Journal of neurophysiology.

[41]  Brian J. Murphy,et al.  Summation and discrimination of gratings moving in opposite directions , 1980, Vision Research.

[42]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[43]  M C Morrone,et al.  Inhibitory interactions in the human vision system revealed in pattern‐evoked potentials. , 1987, The Journal of physiology.

[44]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[45]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[46]  T. Poggio,et al.  A synaptic mechanism possibly underlying directional selectivity to motion , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[47]  Alexa Riehle,et al.  Directionally Selective Motion Detection by Insect Neurons , 1989 .

[48]  D. G. Albrecht,et al.  Striate cortex of monkey and cat: contrast response function. , 1982, Journal of neurophysiology.

[49]  N. Kawabata,et al.  Neural interactions of two moving patterns in the direction and orientation domain in the complex cells of cat's visual cortex , 1985, Vision Research.

[50]  B Moulden,et al.  A Simultaneous Shift in Apparent Direction: Further Evidence for a “Distribution-Shift” Model of Direction Coding , 1980, The Quarterly journal of experimental psychology.

[51]  J J Koenderink,et al.  Perception of Movement and Correlation in Stroboscopically Presented Noise Patterns , 1985, Perception.

[52]  G. Mather The Movement Aftereffect and a Distribution-Shift Model for Coding the Direction of Visual Movement , 1980, Perception.

[53]  B Moulden,et al.  Thresholds for Movement Direction: Two Directions are Less Detectable than One , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[54]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[55]  C. Koch,et al.  Functional properties of models for direction selectivity in the retina , 1987, Synapse.

[56]  T. Albright Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[57]  A. M. Sillito Pharmacological approach to the visual cortex , 1979, Trends in Neurosciences.

[58]  P. G. H. Clarke,et al.  Subjective standstill caused by the interaction of moving patterns , 1977, Vision Research.

[59]  B Moulden,et al.  In Defence of a Ratio Model for Movement Detection at Threshold , 1978, The Quarterly journal of experimental psychology.

[60]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[61]  B Julesz,et al.  Cooperative and non-cooperative processes of apparent movement of random-dot cinematograms. , 1985, Spatial vision.

[62]  Curtis L. Baker,et al.  Space-time separability of direction selectivity in cat striate cortex neurons , 1988, Vision Research.

[63]  F. Gallyas Silver staining of myelin by means of physical development. , 1979, Neurological research.

[64]  K. Nakayama,et al.  Intact “biological motion” and “structure from motion” perception in a patient with impaired motion mechanisms: A case study , 1990, Visual Neuroscience.

[65]  J S Lappin,et al.  The perceptual coherence of moving visual patterns. , 1981, Acta psychologica.

[66]  R. M. Siegel,et al.  Corticocortical connections of anatomically and physiologically defined subdivisions within the inferior parietal lobule , 1990, The Journal of comparative neurology.

[67]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. III. Psychophysics and physiology of apparent motion. , 1986, Journal of neurophysiology.

[68]  Klein,et al.  Nonlinear directionally selective subunits in complex cells of cat striate cortex. , 1987, Journal of neurophysiology.

[69]  E. Hildreth The computation of the velocity field , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[70]  O. Creutzfeldt,et al.  Significance of intracortical inhibition in the visual cortex. , 1972, Nature: New biology.

[71]  K. Nakayama,et al.  Visual thresholds for shearing motion in monkey and man , 1985, Vision Research.

[72]  Ruth E M Bowden,et al.  The Inhibitory Pathways of the Central Nervous System , 1970 .

[73]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[74]  P Hammond,et al.  Directional tuning interactions between moving oriented and textured stimuli in complex cells of feline striate cortex. , 1983, The Journal of physiology.

[75]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[76]  L Ganz,et al.  Mechanism of directional selectivity in simple neurons of the cat's visual cortex analyzed with stationary flash sequences. , 1984, Journal of neurophysiology.

[77]  R. Andersen,et al.  The influence of the angle of gaze upon the excitability of the light- sensitive neurons of the posterior parietal cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[78]  N. Sutherland Figural After-Effects and Apparent Size , 1961 .

[79]  A. Yuille,et al.  A model for the estimate of local image velocity by cells in the visual cortex , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[80]  K. Tanaka,et al.  Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  Stefan Treue,et al.  Surface Interpolation in Three-Dimensional Structure-from-Motion Perception , 1989, Neural Computation.

[82]  David C. Burr,et al.  Evidence for the existence and development of visual inhibition in humans , 1986, Nature.

[83]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[84]  G. Phillips,et al.  Cooperative phenomena in the perception of motion direction. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[85]  R. Sekuler,et al.  Assimilation and contrast in motion perception: Explorations in cooperativity , 1990, Vision Research.

[86]  G. Orban,et al.  Laminar analysis of motion information processing in macaque V5 , 1989, Brain Research.

[87]  M J Morgan,et al.  Interocular Delay Produces Depth in Subjectively Moving Noise Patterns , 1980, The Quarterly journal of experimental psychology.

[88]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[89]  R. Sekuler,et al.  Adaptation alters perceived direction of motion , 1976, Vision Research.

[90]  S. Blomfield Arithmetical operations performed by nerve cells. , 1974, Brain research.

[91]  J Allman,et al.  Direction- and Velocity-Specific Responses from beyond the Classical Receptive Field in the Middle Temporal Visual Area (MT) , 1985, Perception.

[92]  B M Dow,et al.  The mapping of visual space onto foveal striate cortex in the macaque monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[93]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[94]  D. Mackay,et al.  Modulatory influences of moving textured backgrounds on responsiveness of simple cells in feline striate cortex , 1981, The Journal of physiology.

[95]  D. Ferster Orientation selectivity of synaptic potentials in neurons of cat primary visual cortex , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[96]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[97]  A. B. Bonds Role of Inhibition in the Specification of Orientation Selectivity of Cells in the Cat Striate Cortex , 1989, Visual Neuroscience.

[98]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[99]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[100]  M. Hawken,et al.  Laminar organization and contrast sensitivity of direction-selective cells in the striate cortex of the Old World monkey , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[101]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[102]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[103]  F. Amthor,et al.  Nonlinearity of the inhibition underlying retinal directional selectivity , 1991, Visual Neuroscience.

[104]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[105]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[106]  K. Hoffmann,et al.  Quantitative analysis of visual receptive fields of neurons in nucleus of the optic tract and dorsal terminal nucleus of the accessory optic tract in macaque monkey. , 1989, Journal of neurophysiology.

[107]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. II. Spatiotemporal range of directional interactions in MT and V1. , 1986, Journal of neurophysiology.

[108]  D. M. MacKAY,et al.  Visual Effects of Non-redundant Stimulation , 1961, Nature.

[109]  O. Braddick,et al.  The combination of motion signals over time , 1989, Vision Research.

[110]  R A Andersen,et al.  Hierarchical processing of motion in the visual cortex of monkey. , 1990, Cold Spring Harbor symposia on quantitative biology.