The Costs of Ignoring High-Order Correlations in Populations of Model Neurons

Investigators debate the extent to which neural populations use pairwise and higher-order statistical dependencies among neural responses to represent information about a visual stimulus. To study this issue, three statistical decoders were used to extract the information in the responses of model neurons about the binocular disparities present in simulated pairs of left-eye and right-eye images: (1) the full joint probability decoder considered all possible statistical relations among neural responses as potentially important; (2) the dependence tree decoder also considered all possible relations as potentially important, but it approximated high-order statistical correlations using a computationally tractable procedure; and (3) the independent response decoder, which assumed that neural responses are statistically independent, meaning that all correlations should be zero and thus can be ignored. Simulation results indicate that high-order correlations among model neuron responses contain significant information about binocular disparities and that the amount of this high-order information increases rapidly as a function of neural population size. Furthermore, the results highlight the potential importance of the dependence tree decoder to neuroscientists as a powerful but still practical way of approximating high-order correlations among neural responses.

[1]  C. N. Liu,et al.  Approximating discrete probability distributions with dependence trees , 1968, IEEE Trans. Inf. Theory.

[2]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[3]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[4]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[5]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[6]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[7]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[8]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[9]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[10]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[11]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[12]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[13]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[14]  I. Ohzawa,et al.  Neural mechanisms underlying binocular fusion and stereopsis: position vs. phase. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[15]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[16]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[17]  E T Rolls,et al.  Correlations and the encoding of information in the nervous system , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  Michael I. Jordan,et al.  Learning with Mixtures of Trees , 2001, J. Mach. Learn. Res..

[19]  William Bialek,et al.  Synergy in a Neural Code , 2000, Neural Computation.

[20]  T. Shibasaki,et al.  Retinal ganglion cells act largely as independent encoders , 2001 .

[21]  A. Parker,et al.  Stereoacuity thresholds in the presence of a reference surface , 2001, Vision Research.

[22]  A. Parker,et al.  Quantitative analysis of the responses of V1 neurons to horizontal disparity in dynamic random-dot stereograms. , 2002, Journal of neurophysiology.

[23]  Stefano Panzeri,et al.  The role of correlated firing and synchrony in coding information about single and separate objects in cat V1 , 2002, Neurocomputing.

[24]  Hermann Wagner,et al.  Visual depth encoding in populations of neurons with localized receptive fields , 2002, Biological Cybernetics.

[25]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[26]  Steven Reece,et al.  An information theoretic approach to the contributions of the firing rates and the correlations between the firing of neurons. , 2003, Journal of neurophysiology.

[27]  Daeyeol Lee,et al.  Neural Noise and Movement-Related Codes in the Macaque Supplementary Motor Area , 2003, The Journal of Neuroscience.

[28]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Jonathan D. Victor,et al.  Reading a population code: a multi-scale neural model for representing binocular disparity , 2003, Vision Research.

[30]  B. Cumming,et al.  Testing quantitative models of binocular disparity selectivity in primary visual cortex. , 2003, Journal of neurophysiology.

[31]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[32]  Daeyeol Lee,et al.  Coding and transmission of information by neural ensembles , 2004, Trends in Neurosciences.

[33]  R. Perez,et al.  Retinal correspondence of monocular receptive fields in disparity-sensitive complex cells from area V1 in the awake monkey. , 2005, Investigative ophthalmology & visual science.

[34]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.