A two layer disparity selective simple cell model

The responses of disparity selective complex cells in the mammalian visual system are often modeled by the disparity energy model. This model linearly combines inputs from binocular simple cell units, whose responses are computed by the combination of left and right eye inputs through linear binocular receptive fields, followed by half wave rectification and an expansive nonlinearity. While many complex cells have responses that can be modeled by the standard disparity energy model, there are many that cannot be. While the standard disparity energy model has been extended to account for some specific types of tuning (e.g. cells that are “monocularly responsive” in that they only respond to input from one eye, yet are disparity tuned indicating that they receive input from both eyes), actual neurons display a wider range of ocular dominance indices and disparity selectivities than can be fully accounted for by these models. Here, we describe a two layer simple cell model that can be used to construct complex cells that fully cover this range. The model combines the responses from a first layer of model monocular simple cells. By adjusting the weights from the monocular to a second binocular layer, the model can exhibit more diverse tuning properties than previously proposed models. We also show that these weights can be learned by sparse coding, and that if so, there is a strong relationship between distribution of tuning properties in the population and the input disparity statistics.

[1]  B. Cumming,et al.  Suppressive Mechanisms in Monkey V1 Help to Solve the Stereo Correspondence Problem , 2011, The Journal of Neuroscience.

[2]  B. Cumming,et al.  Testing quantitative models of binocular disparity selectivity in primary visual cortex. , 2003, Journal of neurophysiology.

[3]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  Jeffrey S. Perry,et al.  Statistics for optimal point prediction in natural images. , 2011, Journal of vision.

[5]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[6]  Y. Chino,et al.  Postnatal Development of Binocular Disparity Sensitivity in Neurons of the Primate Visual Cortex , 1997, The Journal of Neuroscience.

[7]  I. Ohzawa,et al.  Encoding of binocular disparity by simple cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[8]  P. O. Bishop,et al.  Neural mechanisms of binocular vision , 1986, Vision Research.

[9]  Aapo Hyvärinen,et al.  A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images , 2001, Vision Research.

[10]  I. Ohzawa,et al.  The binocular organization of simple cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[11]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[12]  Bruce G Cumming,et al.  Ocular dominance predicts neither strength nor class of disparity selectivity with random-dot stimuli in primate V1. , 2004, Journal of neurophysiology.

[13]  Johannes Burge,et al.  Binocular integration and disparity selectivity in mouse primary visual cortex. , 2013, Journal of neurophysiology.

[14]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[15]  Yu Zhao,et al.  A unified model of the joint development of disparity selectivity and vergence control , 2012, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[16]  Bruce G Cumming,et al.  A simple model accounts for the response of disparity-tuned V1 neurons to anticorrelated images , 2002, Visual Neuroscience.

[17]  S. Levay,et al.  Ocular dominance and disparity coding in cat visual cortex , 1988, Visual Neuroscience.

[18]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[19]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[20]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[21]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[22]  Justin M. Ales,et al.  Disparity-Tuned Population Responses from Human Visual Cortex , 2011, The Journal of Neuroscience.