Encoding of three-dimensional surface slant in cat visual areas 17 and 18.

How are surface orientations of three-dimensional objects and scenes represented in the visual system? We have examined an idea that these surface orientations are encoded by neurons with a variety of tilts in their binocular receptive field (RF) structure. To examine whether neurons in the early visual areas are capable of encoding surface orientations, we have recorded from single neurons extracellularly in areas 17 and 18 of the cat using standard electrophysiological methods. Binocular RF structures are obtained using a binocular version of the reverse correlation technique. About 30% of binocularly responsive neurons have RFs with statistically significant tilts from the frontoparallel plane. The degree of tilts is sufficient for representing the range of surface slants found in typical visual environments. For a subset of neurons having significant RF tilts, the degrees of tilt are correlated with the preferred spatial frequency difference between the two eyes, indicating that a modified disparity energy model can account for the selectivity, at least partially. However, not all cases could be explained by this model, suggesting that multiple mechanisms may be responsible. Therefore an alternative hypothesis is also examined, where the tilt is generated by pooling of multiple disparity detectors whose preferred disparities progressively shift over space. Although there is evidence for extensive spatial pooling, this hypothesis was not satisfactory either, in that the neurons with extensive pooling tended to prefer an untilted surface. Our results suggest that encoding of surface orientations may begin with the binocular neurons in the early visual cortex.

[1]  R D Freeman,et al.  Neuronal Mechanisms Underlying Stereopsis: How Do Simple Cells in the Visual Cortex Encode Binocular Disparity? , 1995, Perception.

[2]  Ning Qian,et al.  Relationship Between Phase and Energy Methods for Disparity Computation , 2000, Neural Computation.

[3]  B. Efron.  The jackknife, the bootstrap, and other resampling plans , 1987 .

[4]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information II. Complex cells. , 1999, Journal of neurophysiology.

[5]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[6]  B. Julesz,et al.  A disparity gradient limit for binocular fusion. , 1980, Science.

[7]  C. Tyler,et al.  Depth from spatial frequency difference: An old kind of stereopsis? , 1979, Vision Research.

[8]  P. O. Bishop,et al.  Analysis of retinal correspondence by studying receptive fields of rinocular single units in cat striate cortex , 2004, Experimental Brain Research.

[9]  P. Hammond,et al.  Interocular mismatch in spatial frequency and directionality characteristics of striate cortical neurones , 2004, Experimental Brain Research.

[10]  H. Wilson.  The significance of frequency gradients in binocular grating perception , 1976, Vision Research.

[11]  I. Ohzawa,et al.  Encoding of binocular disparity by simple cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[12]  P. O. Bishop,et al.  Discrimination of orientation and position disparities by binocularly activated neurons in cat straite cortex. , 1977, Journal of neurophysiology.

[13]  L Maffei,et al.  Binocular depth perception without geometrical cues. , 1971, Vision research.

[14]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[15]  D. Ringach,et al.  On the classification of simple and complex cells , 2002, Vision Research.

[16]  Guillermo Sapiro,et al.  A subspace reverse-correlation technique for the study of visual neurons , 1997, Vision Research.

[17]  B G Cumming,et al.  Responses of Macaque V1 Neurons to Binocular Orientation Differences , 2001, The Journal of Neuroscience.

[18]  Rufin Vogels,et al.  Convergence of Depth from Texture and Depth from Disparity in Macaque Inferior Temporal Cortex , 2004, The Journal of Neuroscience.

[19]  J. P. Jones,et al.  The two-dimensional spectral structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[20]  S. Levay,et al.  Ocular dominance and disparity coding in cat visual cortex , 1988, Visual Neuroscience.

[21]  C. Blakemore,et al.  A second neural mechanism of binocular depth discrimination , 1972, The Journal of physiology.

[22]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[23]  S. A. Lloyd,et al.  The Role of Disparity Gradient in Stereo Vision , 1985, Perception.

[24]  B. Cumming,et al.  Testing quantitative models of binocular disparity selectivity in primary visual cortex. , 2003, Journal of neurophysiology.

[25]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[26]  C. Connor,et al.  Three-dimensional orientation tuning in macaque area V4 , 2002, Nature Neuroscience.

[27]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information I. Simple cells. , 1999, Journal of neurophysiology.

[28]  I. Ohzawa,et al.  The binocular organization of complex cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[29]  I. Ohzawa,et al.  The binocular organization of simple cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[30]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. , 1993, Journal of neurophysiology.

[31]  H. Sakata,et al.  Parietal neurons represent surface orientation from the gradient of binocular disparity. , 2000, Journal of neurophysiology.

[32]  R Vogels,et al.  Macaque inferior temporal neurons are selective for disparity-defined three-dimensional shapes. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[33]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[34]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[35]  A. B. Bonds,et al.  Classifying simple and complex cells on the basis of response modulation , 1991, Vision Research.

[36]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[37]  Shinji Nishimoto,et al.  Accuracy of subspace mapping of spatiotemporal frequency domain visual receptive fields. , 2005, Journal of neurophysiology.

[38]  A. Parker,et al.  Modeling V1 neuronal responses to orientation disparity , 2001, Visual Neuroscience.

[39]  D. Ringach,et al.  Spatial overlap of ON and OFF subregions and its relation to response modulation ratio in macaque primary visual cortex. , 2005, Journal of neurophysiology.

[40]  Jerry D. Nguyenkim,et al.  Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons , 2003, The Journal of Neuroscience.

[41]  G. Orban,et al.  Three-Dimensional Shape Coding in Inferior Temporal Cortex , 2000, Neuron.

[42]  D. Ferster.  A comparison of binocular depth mechanisms in areas 17 and 18 of the cat visual cortex , 1981, The Journal of physiology.

[43]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[44]  A. Hughes,et al.  A useful table of reduced schematic eyes for vertebrates which includes computed longitudinal chromatic aberrations , 1979, Vision Research.

[45]  RANDOLPH BLAKE,et al.  Stereopsis from Interocular Spatial Frequency Differences is Not Robust , 1996, Vision Research.

[46]  C. Blakemore,et al.  A new kind of stereoscopic vision. , 1970, Vision research.

[47]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[48]  Roger W. Johnson,et al.  An Introduction to the Bootstrap , 2001 .

[49]  Takahiro Doi,et al.  Disparity-tuning characteristics of neuronal responses to dynamic random-dot stereograms in macaque visual area V4. , 2005, Journal of neurophysiology.

[50]  R. Freeman,et al.  Oblique effect: a neural basis in the visual cortex. , 2003, Journal of neurophysiology.