Modeling V1 disparity tuning to time-varying stimuli.

Most models of disparity selectivity consider only the spatial properties of binocular cells. However, the temporal response is an integral component of real neurons' activities, and time-varying stimuli are often used in the experiments of disparity tuning. To understand the temporal dimension of V1 disparity representation, we incorporate a specific temporal response function into the disparity energy model and demonstrate that the binocular interaction of complex cells is separable into a Gabor disparity function and a positive time function. We then investigate how the model simple and complex cells respond to widely used time-varying stimuli, including motion-in-depth patterns, drifting gratings, moving bars, moving random-dot stereograms, and dynamic random-dot stereograms. It is found that both model simple and complex cells show more reliable disparity tuning to time-varying stimuli than to static stimuli, but similarities in the disparity tuning between simple and complex cells depend on the stimulus. Specifically, the disparity tuning curves of the two cell types are similar to each other for either drifting sinusoidal gratings or moving bars. In contrast, when the stimuli are dynamic random-dot stereograms, the disparity tuning of simple cells is highly variable, whereas the tuning of complex cells remains reliable. Moreover, cells with similar motion preferences in the two eyes cannot be truly tuned to motion in depth regardless of the stimulus types. These simulation results are consistent with a large body of extant physiological data, and provide some specific, testable predictions.

[1]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[2]  Processing of Foods with Ionizing Radiations , 1958, Nature.

[3]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[4]  G. Poggio,et al.  Stereoscopic mechanisms in monkey visual cortex: binocular correlation and disparity selectivity , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  R. Andersen,et al.  Integration of motion and stereopsis in middle temporal cortical area of macaques , 1995, Nature.

[6]  John H. R. Maunsell,et al.  Coding of image contrast in central visual pathways of the macaque monkey , 1990, Vision Research.

[7]  Ning Qian,et al.  Binocular Receptive Field Models, Disparity Tuning, and Characteristic Disparity , 1996, Neural Computation.

[8]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information I. Simple cells. , 1999, Journal of neurophysiology.

[9]  M. Cynader,et al.  Neurones in cat parastriate cortex sensitive to the direction of motion in three‐dimensional space , 1978, The Journal of physiology.

[10]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[11]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[12]  F. A. Miles,et al.  Vergence eye movements in response to binocular disparity without depth perception , 1997, Nature.

[13]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. I. Psychophysics , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  I. Ohzawa,et al.  Encoding of binocular disparity by simple cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[15]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[16]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  N. Qian Binocular Disparity and the Perception of Depth , 1997, Neuron.

[18]  D. G. Albrecht,et al.  Striate cortex of monkey and cat: contrast response function. , 1982, Journal of neurophysiology.

[19]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[20]  Ning Qian,et al.  Relationship Between Phase and Energy Methods for Disparity Computation , 2000, Neural Computation.

[21]  Ning Qian,et al.  A physiologically-based explanation of disparity attraction and repulsion , 2000, Vision Research.

[22]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[23]  N. Qian,et al.  A Physiological Model for Motion-Stereo Integration and a Unified Explanation of Pulfrich-like Phenomena , 1997, Vision Research.

[24]  Julie M. Harris,et al.  Speed discrimination of motion-in-depth using binocular cues , 1995, Vision Research.

[25]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.

[26]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[27]  E. Adelson,et al.  Directionally selective complex cells and the computation of motion energy in cat visual cortex , 1992, Vision Research.

[28]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[29]  R. L. de Valois,et al.  Responses of simple and complex cells to random dot patterns: a quantitative comparison. , 1988, Journal of neurophysiology.

[30]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information II. Complex cells. , 1999, Journal of neurophysiology.

[31]  M Nawrot,et al.  Neural integration of information specifying structure from stereopsis and motion. , 1989, Science.

[32]  G. Poggio,et al.  Mechanisms of static and dynamic stereopsis in foveal cortex of the rhesus monkey , 1981, The Journal of physiology.

[33]  B. C. Motter,et al.  Responses of neurons in visual cortex (V1 and V2) of the alert macaque to dynamic random-dot stereograms , 1985, Vision Research.

[34]  G Westheimer Detection of disparity motion by the human observer. , 1990, Optometry and vision science : official publication of the American Academy of Optometry.

[35]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. , 1993, Journal of neurophysiology.

[36]  I. Ohzawa,et al.  The binocular organization of complex cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[37]  S M Anstis,et al.  Movement Aftereffects Contingent on Binocular Disparity , 1974, Perception.

[38]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[39]  D. Regan,et al.  Disparity Detectors in Human Depth Perception: Evidence for Directional Selectivity , 1973, Science.

[40]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[41]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[42]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[43]  D. Pollen,et al.  Space-time spectra of complex cell filters in the macaque monkey: A comparison of results obtained with pseudowhite noise and grating stimuli , 1994, Visual Neuroscience.

[44]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[45]  B. G. Cumming,et al.  Binocular mechanisms for detecting motion-in-depth , 1994, Vision Research.

[46]  R. Shapley,et al.  Temporal-frequency selectivity in monkey visual cortex , 1996, Visual Neuroscience.

[47]  I. Ohzawa,et al.  Functional Micro-Organization of Primary Visual Cortex: Receptive Field Analysis of Nearby Neurons , 1999, The Journal of Neuroscience.

[48]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[49]  Pulfrich-like Phenomena,et al.  A Physiological Model for Motion-Stereo Integration and a Unified Explanation of , 1997 .

[50]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[51]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[52]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[53]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. I. Spatiotemporal organization of receptive fields. , 1976, Journal of neurophysiology.

[54]  MARIE BOAS HALL Galileo 400 Years After , 1966, Nature.

[55]  I. Ohzawa,et al.  The binocular organization of simple cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[56]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.