Visual depth encoding in populations of neurons with localized receptive fields

Abstract. Stereopsis is the ability to perceive three-dimensional structure from disparities between the two-dimensional retinal images. Although disparity-sensitive neurons have been proposed as a neural representation of this ability many years ago, it is still difficult to link all qualities of stereopsis to properties of the neural correlate of binocular disparities. The present study wants to support efforts directed at closing the gap between electrophysiology and psychophysics. Populations of disparity-sensitive neurons in V1 were simulated using the energy-neuron model. Responses to different types of stimuli were evaluated with an efficient statistical estimator and related to psychophysical findings. The representation of disparity in simulated population responses appeared to be very robust. Small populations allowed good depth discrimination. Two types of energy neurons (phase- and position-type models) that are discussed as possible neural implementations of disparity-selectivity could be compared to each other. Phase-type coding was more robust and could explain a tendency towards zero disparity in degenerated stimuli and, for high-pass stimuli, exhibited the breakdown of disparity discrimination at a maximum disparity value. Contrast-inverted stereograms led to high variances in disparity representation, which is a possible explanation of the absence of depth percepts in large contrast-inverted stimuli. Our study suggests that nonlocal interactions destroy depth percepts in large contrast-inverted stereograms, although these percepts occur for smaller stimuli of the same class.

[1]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[2]  David J. Fleet,et al.  Disparity tuning as simulated by a neural net , 2000, Biological Cybernetics.

[3]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[4]  Ning Qian,et al.  Binocular Receptive Field Models, Disparity Tuning, and Characteristic Disparity , 1996, Neural Computation.

[5]  Richard A Eagle,et al.  Weighted directional energy model of human stereo correspondence , 2000, Vision Research.

[6]  J. Pettigrew,et al.  Neurons selective for orientation and binocular disparity in the visual Wulst of the barn owl (Tyto alba). , 1976, Science.

[7]  Rama Chellappa,et al.  Markov random field models in image processing , 1998 .

[8]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[9]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[10]  H. Wagner,et al.  Horizontal-disparity tuning of neurons in the visual forebrain of the behaving barn owl. , 2000, Journal of neurophysiology.

[11]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[12]  H. Wagner,et al.  Hierarchical Processing of Horizontal Disparity Information in the Visual Forebrain of Behaving Owls , 2001, The Journal of Neuroscience.

[13]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  I. Ohzawa,et al.  Neural mechanisms underlying binocular fusion and stereopsis: position vs. phase. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[15]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[16]  A. Parker,et al.  The Precision of Single Neuron Responses in Cortical Area V1 during Stereoscopic Depth Judgments , 2000, The Journal of Neuroscience.

[17]  Colin Blakemore,et al.  Probing the human stereoscopic system with reverse correlation , 1999, Nature.

[18]  Ian P. Howard,et al.  Binocular Vision and Stereopsis , 1996 .

[19]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[20]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[21]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[22]  Alexander I. Cogan,et al.  Depth in anticorrelated stereograms: Effects of spatial density and interocular delay , 1993, Vision Research.

[23]  M S Gray,et al.  Reliable disparity estimation through selective integration , 1998, Visual Neuroscience.

[24]  Hermann Wagner,et al.  Disparity-sensitive cells in the owl have a characteristic disparity , 1993, Nature.

[25]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[27]  Jenny C. A. Read A Bayesian model of stereopsis depth and motion direction discrimination , 2002, Biological Cybernetics.

[28]  Richard A Eagle,et al.  Stereo correspondence in one-dimensional Gabor stimuli , 2000, Vision Research.

[29]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[30]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[31]  Bartlett W. Mel,et al.  A model for intradendritic computation of binocular disparity , 2000, Nature Neuroscience.

[32]  Doris Y. Tsao,et al.  Receptive fields of disparity-selective neurons in macaque striate cortex , 1999, Nature Neuroscience.

[33]  Richard A Eagle,et al.  Reversed stereo depth and motion direction with anti-correlated stimuli , 2000, Vision Research.

[34]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[35]  Peter E. Latham,et al.  Statistically Efficient Estimation Using Population Coding , 1998, Neural Computation.

[36]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[37]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[38]  H. Wagner,et al.  A threshold explains modulation of neural responses to opposite-contrast stereograms , 2001, Neuroreport.

[39]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.