Spatial frequency integration for binocular correspondence in macaque area V4.

Neurons in the primary visual cortex (V1) detect binocular disparity by computing the local disparity energy of stereo images. The representation of binocular disparity in V1 contradicts the global correspondence when the image is binocularly anticorrelated. To solve the stereo correspondence problem, this rudimentary representation of stereoscopic depth needs to be further processed in the extrastriate cortex. Integrating signals over multiple spatial frequency channels is one possible mechanism supported by theoretical and psychophysical studies. We examined selectivities of single V4 neurons for both binocular disparity and spatial frequency in two awake, fixating monkeys. Disparity tuning was examined with a binocularly correlated random-dot stereogram (RDS) as well as its anticorrelated counterpart, whereas spatial frequency tuning was examined with a sine wave grating or a narrowband noise. Neurons with broader spatial frequency tuning exhibited more attenuated disparity tuning for the anticorrelated RDS. Additional rectification at the output of the energy model does not likely account for this attenuation because the degree of attenuation does not differ among the various types of disparity-tuned neurons. The results suggest that disparity energy signals are integrated across spatial frequency channels for generating a representation of stereoscopic depth in V4.

[1]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[2]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[3]  Michael A. Webster,et al.  Blur thresholds following blur adaptation , 2004 .

[4]  B G Cumming,et al.  Responses of Macaque V1 Neurons to Binocular Orientation Differences , 2001, The Journal of Neuroscience.

[5]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  P. Hammond,et al.  Interocular mismatch in spatial frequency and directionality characteristics of striate cortical neurones , 2004, Experimental Brain Research.

[7]  Izumi Ohzawa,et al.  Mechanisms of stereoscopic vision: the disparity energy model , 1998, Current Opinion in Neurobiology.

[8]  Ichiro Fujita,et al.  Disparity-selective neurons in area V4 of macaque monkeys. , 2002 .

[9]  P. O. Bishop,et al.  Analysis of retinal correspondence by studying receptive fields of rinocular single units in cat striate cortex , 2004, Experimental Brain Research.

[10]  H. Wilson,et al.  Coarse spatial scales constrain the range of binocular fusion on fine scales. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[11]  I. Ohzawa,et al.  The binocular organization of complex cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[12]  A. Dean.  The variability of discharge of simple cells in the cat striate cortex , 2004, Experimental Brain Research.

[13]  Ralph D Freeman,et al.  Functional connectivity of disparity-tuned neurons in the visual cortex. , 2004, Journal of neurophysiology.

[14]  H. Wagner,et al.  Hierarchical Processing of Horizontal Disparity Information in the Visual Forebrain of Behaving Owls , 2001, The Journal of Neuroscience.

[15]  Ichiro Fujita,et al.  Spatial frequency integration for stereo processing in macaque visual area V4 , 2010 .

[16]  Takahiro Doi,et al.  Disparity-tuning characteristics of neuronal responses to dynamic random-dot stereograms in macaque visual area V4. , 2005, Journal of neurophysiology.

[17]  Bruce G Cumming,et al.  A simple model accounts for the response of disparity-tuned V1 neurons to anticorrelated images , 2002, Visual Neuroscience.

[18]  A. Parker,et al.  Binocular Neurons in V1 of Awake Monkeys Are Selective for Absolute, Not Relative, Disparity , 1999, The Journal of Neuroscience.

[19]  Ralph D Freeman,et al.  Temporal dynamics of binocular disparity processing in the central visual pathway. , 2004, Journal of neurophysiology.

[20]  David J. Fleet,et al.  Disparity tuning as simulated by a neural net , 2000, Biological Cybernetics.

[21]  R. Freeman,et al.  Stereoscopic depth processing in the visual cortex: a coarse-to-fine mechanism , 2003, Nature Neuroscience.

[22]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[23]  Doris Y. Tsao,et al.  Receptive fields of disparity-selective neurons in macaque striate cortex , 1999, Nature Neuroscience.

[24]  P. O. Bishop.  NEURAL MECHANISMS FOR BINOCULAR DEPTH DISCRIMINATION , 1981 .

[25]  Richard A Eagle,et al.  Reversed stereo depth and motion direction with anti-correlated stimuli , 2000, Vision Research.

[26]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[27]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[28]  Y. Chino,et al.  Binocular spatial phase tuning characteristics of neurons in the macaque striate cortex. , 1997, Journal of neurophysiology.

[29]  Ichiro Fujita,et al.  Representation of stereoscopic depth based on relative disparity in macaque area V4. , 2007, Journal of neurophysiology.

[30]  H. Smallman.  Fine-to-coarse scale disambiguation in stereopsis , 1995, Vision Research.

[31]  Alexander I. Cogan,et al.  Depth in anticorrelated stereograms: Effects of spatial density and interocular delay , 1993, Vision Research.

[32]  J. A. Movshon,et al.  The dependence of response amplitude and variance of cat visual cortical neurones on stimulus contrast , 1981, Experimental Brain Research.

[33]  B. Cumming,et al.  Testing quantitative models of binocular disparity selectivity in primary visual cortex. , 2003, Journal of neurophysiology.

[34]  Jonathan D. Victor,et al.  Reading a population code: a multi-scale neural model for representing binocular disparity , 2003, Vision Research.

[35]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[36]  A. Parker,et al.  Range and mechanism of encoding of horizontal disparity in macaque V1. , 2002, Journal of neurophysiology.

[37]  I. Ohzawa,et al.  The binocular organization of simple cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[38]  A. M. Rohaly,et al.  Nature of coarse-to-fine constraints on binocular fusion. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[40]  Bart Farell,et al.  Coarse scales, fine scales, and their interactions in stereo vision. , 2004, Journal of vision.

[41]  Jenny C. A. Read.  A Bayesian model of stereopsis depth and motion direction discrimination , 2002, Biological Cybernetics.

[42]  S. McKee,et al.  Stereoscopic acuity with defocused and spatially filtered retinal images , 1980 .

[43]  Andrew J. Parker,et al.  Local Disparity Not Perceived Depth Is Signaled by Binocular Neurons in Cortical Area V1 of the Macaque , 2000, The Journal of Neuroscience.

[44]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information I. Simple cells. , 1999, Journal of neurophysiology.

[45]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[46]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[47]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[48]  I. Ohzawa,et al.  Encoding of binocular disparity by simple cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[49]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information II. Complex cells. , 1999, Journal of neurophysiology.

[50]  D. Pollen,et al.  Spatial and temporal frequency selectivity of neurones in visual cortical areas V1 and V2 of the macaque monkey. , 1985, The Journal of physiology.

[51]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[52]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[53]  G. Orban,et al.  At Least at the Level of Inferior Temporal Cortex, the Stereo Correspondence Problem Is Solved , 2003, Neuron.

[54]  A. M. Rohaly,et al.  Disparity averaging across spatial scales , 1994, Vision Research.

[55]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[56]  H. Wagner,et al.  A threshold explains modulation of neural responses to opposite-contrast stereograms , 2001, Neuroreport.

[57]  B G Cumming,et al.  Disparity Detection in Anticorrelated Stereograms , 1998, Perception.

[58]  Bruce G Cumming,et al.  Ocular dominance predicts neither strength nor class of disparity selectivity with random-dot stimuli in primate V1. , 2004, Journal of neurophysiology.

[59]  I. Fujita,et al.  Rejection of False Matches for Binocular Correspondence in Macaque Visual Cortical Area V4 , 2004, The Journal of Neuroscience.

[60]  B. Julesz.  Foundations of Cyclopean Perception , 1971 .

[61]  A. Parker,et al.  Quantitative analysis of the responses of V1 neurons to horizontal disparity in dynamic random-dot stereograms. , 2002, Journal of neurophysiology.

[62]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[63]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[64]  B. G. Cumming,et al.  An unexpected specialization for horizontal disparity in primate primary visual cortex , 2002, Nature.

[65]  R. Desimone,et al.  Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. , 1987, Journal of neurophysiology.