Effect of interocular delay on disparity-selective v1 neurons: relationship to stereoacuity and the pulfrich effect.

The temporal properties of disparity-sensitive neurons place important temporal constraints on stereo matching. We examined these constraints by measuring the responses of disparity-selective neurons in striate cortex of awake behaving monkeys to random-dot stereograms that contained interocular delays. Disparity selectivity was gradually abolished by increasing interocular delay (when the delay exceeds the integration time, the inputs from the 2 eyes become uncorrelated). The amplitude of the disparity-selective response was a Gaussian function of interocular delay, with a mean of 16 ms (+/-5 ms, SD). Psychophysical measures of stereoacuity, in both monkey and human observers, showed a closely similar dependency on time, suggesting that temporal integration in V1 neurons is what determines psychophysical matching constraints over time. There was a slight but consistent asymmetry in the neuronal responses, as if the optimum stimulus is one in which the right stimulus leads by about 4 ms. Because all recordings were made in the left hemisphere, this probably reflects nasotemporal differences in conduction times; psychophysical data are compatible with this interpretation. In only a few neurons (5/72), interocular delay caused a change in the preferred disparity. Such tilted disparity/delay profiles have been invoked previously to explain depth perception in the stroboscopic version of the Pulfrich effect (and other variants). However, the great majority of the neurons did not show tilted disparity/delay profiles. This suggests that either the activity of these neurons is ignored when viewing Pulfrich stimuli, or that current theories relating neuronal properties to perception in the Pulfrich effect need to be reevaluated.

[1]  I. Ohzawa,et al.  Direction selectivity of cells in the cat's striate cortex: Differences between bar and grating stimuli , 1992, Visual Neuroscience.

[2]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. , 1993, Journal of neurophysiology.

[3]  C. Pulfrich Die Stereoskopie im Dienste der isochromen und heterochromen Photometrie , 2005, Naturwissenschaften.

[4]  J. Ross The resources of binocular perception. , 1976, Scientific American.

[5]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[6]  R. Freeman,et al.  A physiological correlate of the pulfrich effect in cortical neurons of the cat , 1989, Vision Research.

[7]  Jenny C. A. Read,et al.  A Bayesian Approach to the Stereo Correspondence Problem , 2002, Neural Computation.

[8]  Y Chen,et al.  Modeling V1 disparity tuning to time-varying stimuli. , 2001, Journal of neurophysiology.

[9]  Robert M. Douglas,et al.  A time-based stereoscopic depth mechanism in the visual cortex , 1985, Brain Research.

[10]  J. Movshon,et al.  Spatial summation in the receptive fields of simple cells in the cat's striate cortex. , 1978, The Journal of physiology.

[11]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[12]  D N Lee,et al.  Spatio-temporal integration in binocular-kinetic space perception. , 1970, Vision research.

[13]  A. Parker,et al.  The Precision of Single Neuron Responses in Cortical Area V1 during Stereoscopic Depth Judgments , 2000, The Journal of Neuroscience.

[14]  George S. Harker,et al.  A saccadic suppression explanation of the Pulfrich phenomenon , 1967 .

[15]  G. S. Harker,et al.  Some observations and measurements of the Pulfrich phenomenon , 1967 .

[16]  C. Pulfrich,et al.  Die Stereoskopie im Dienste der isochromen und heterochromen Photometrie , 2005, Naturwissenschaften.

[17]  Bruce G. Cumming,et al.  Quantitative Analysis of V1 Neurons to horizontal disparity in random dot stereograms , 2002 .

[18]  Gregory C. DeAngelis,et al.  Receptive-field dynamics in the central visual pathways , 1995, Trends in Neurosciences.

[19]  C W Tyler,et al.  Mechanisms for dynamic stereomotion respond selectively to horizontal velocity components , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[21]  Izumi Ohzawa,et al.  Joint-encoding of motion and depth by visual cortical neurons: neural basis of the Pulfrich effect , 2001, Nature Neuroscience.

[22]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[23]  R. Perez,et al.  Interocular temporal delay sensitivity in the visual cortex of the awake monkey , 1999, The European journal of neuroscience.

[24]  J. Movshon,et al.  Selectivity for orientation and direction of motion of single neurons in cat striate and extrastriate visual cortex. , 1990, Journal of neurophysiology.

[25]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. I. Spatiotemporal organization of receptive fields. , 1976, Journal of neurophysiology.

[26]  Jonathan D. Victor,et al.  Reading a population code: a multi-scale neural model for representing binocular disparity , 2003, Vision Research.

[27]  Susumu Tachi,et al.  An integrative model of binocular vision: a stereo model utilizing interocularly unpaired points produces both depth and binocular rivalry , 2004, Vision Research.

[28]  JOHN Ross,et al.  Stereopsis by binocular delay , 1974, Nature.

[29]  David C. Burr,et al.  How does binocular delay give information about depth? , 1979, Vision Research.

[30]  M. Hawken,et al.  Laminar organization and contrast sensitivity of direction-selective cells in the striate cortex of the Old World monkey , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  B. Cumming,et al.  Testing quantitative models of binocular disparity selectivity in primary visual cortex. , 2003, Journal of neurophysiology.

[32]  P. O. Bishop,et al.  Receptive fields of simple cells in the cat striate cortex , 1973, The Journal of physiology.

[33]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[34]  J. Ross,et al.  The pulfrich effect and short-term memory in stereopsis , 1975, Vision Research.

[35]  Tyler Cw Stereomovement from interocular delay in dynamic visual noise: a random spatial disparity hypothesis. , 1977 .

[36]  R. Shapley,et al.  Broadband temporal stimuli decrease the integration time of neurons in cat striate cortex , 1992, Visual Neuroscience.

[37]  R. Shapley,et al.  Temporal-frequency selectivity in monkey visual cortex , 1996, Visual Neuroscience.

[38]  Erich E. Sutter,et al.  The optic nerve head component of the human ERG , 1999, Vision Research.

[39]  G. Orban,et al.  Velocity sensitivity and direction selectivity of neurons in areas V1 and V2 of the monkey: influence of eccentricity. , 1986, Journal of neurophysiology.

[40]  BELA JULESZ,et al.  Short Term Visual Memory and the Pulfrich Phenomenon , 1969, Nature.

[41]  Anthony J. Movshon,et al.  Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys , 1996, The Journal of Neuroscience.

[42]  N. Qian,et al.  A Physiological Model for Motion-Stereo Integration and a Unified Explanation of Pulfrich-like Phenomena , 1997, Vision Research.

[43]  R. Shapley,et al.  Directional selectivity and spatiotemporal structure of receptive fields of simple cells in cat striate cortex. , 1991, Journal of neurophysiology.

[44]  M. J. Morgan,et al.  Motion-stereo mechanisms sensitive to inter-ocular phase , 2000, Vision Research.

[45]  M J Morgan,et al.  Interocular Delay Produces Depth in Subjectively Moving Noise Patterns , 1980, The Quarterly journal of experimental psychology.

[46]  S Kangovi,et al.  An interocular comparison of the multifocal VEP: a possible technique for detecting local damage to the optic nerve. , 2000, Investigative ophthalmology & visual science.

[47]  E. Auerbach,et al.  Electric potentials of retina and cortex of cats evoked by monocular and binocular photic stimulation , 1961 .

[48]  B G Cumming,et al.  Responses of Macaque V1 Neurons to Binocular Orientation Differences , 2001, The Journal of Neuroscience.

[49]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[50]  M. Morgan,et al.  Perception of continuity in stroboscopic motion: A temporal frequency analysis , 1979, Vision Research.

[51]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[52]  N. Qian Binocular Disparity and the Perception of Depth , 1997, Neuron.

[53]  A. Dean The variability of discharge of simple cells in the cat striate cortex , 2004, Experimental Brain Research.

[54]  P. O. Bishop,et al.  Binocular interaction on single units in cat striate cortex: Simultaneous stimulation by single moving slit with receptive fields in correspondence , 2004, Experimental Brain Research.

[55]  D. Tolhurst,et al.  Non-linear temporal summation by simple cells in cat striate cortex demonstrated by failure of superposition , 2005, Experimental Brain Research.

[56]  Eric Castet,et al.  Stereoscopic depth perception at high velocities , 1996 .

[57]  G. ALsnEcHr,et al.  VISUAL CORTICAL RECEPTIVE FIELDS IN MONKEY AND CAT: SPATIAL AND TEMPORAL PHASE TRANSFER FUNCTION , 1989 .

[58]  Margaret S. Livingstone,et al.  Two-Dimensional Substructure of Stereo and Motion Interactions in Macaque Visual Cortex , 2003, Neuron.

[59]  C. WILLIAM TYLER,et al.  Stereopsis in dynamic visual noise , 1974, Nature.

[60]  J Ross,et al.  Short-term memory in stereopsis. , 1974, Vision research.

[61]  D. Tolhurst,et al.  Non-linearities of temporal summation in neurones in area 17 of the cat , 2004, Experimental Brain Research.