Optimal population coding by noisy spiking neurons

In retina and in cortical slice the collective response of spiking neural populations is well described by “maximum-entropy” models in which only pairs of neurons interact. We asked, how should such interactions be organized to maximize the amount of information represented in population responses? To this end, we extended the linear-nonlinear-Poisson model of single neural response to include pairwise interactions, yielding a stimulus-dependent, pairwise maximum-entropy model. We found that as we varied the noise level in single neurons and the distribution of network inputs, the optimal pairwise interactions smoothly interpolated to achieve network functions that are usually regarded as discrete—stimulus decorrelation, error correction, and independent encoding. These functions reflected a trade-off between efficient consumption of finite neural bandwidth and the use of redundancy to mitigate noise. Spontaneous activity in the optimal network reflected stimulus-induced activity patterns, and single-neuron response variability overestimated network noise. Our analysis suggests that rather than having a single coding principle hardwired in their architecture, networks in the brain should adapt their function to changing noise and stimulus correlations.

[1]  Schneidman Elad,et al.  A stimulus-dependent maximum entropy model of the retinal population neural code , 2010 .

[2]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[4]  Balasubramanian Vijay Optimal correlation codes in populations of noisy spiking neurons , 2009 .

[5]  Michael J. Berry,et al.  Network information and connected correlations. , 2003, Physical review letters.

[6]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[7]  W. Bialek,et al.  Optimizing information flow in small genetic networks. II. Feed-forward interactions. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Tatyana O Sharpee,et al.  Maximally informative pairwise interactions in networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Gal Chechik,et al.  Reduction of Information Redundancy in the Ascending Auditory Pathway , 2006, Neuron.

[10]  Michael J. Berry,et al.  Ising models for networks of real neurons , 2006, q-bio/0611072.

[11]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[12]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[13]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  D. Baylor,et al.  Mosaic arrangement of ganglion cell receptive fields in rabbit retina. , 1997, Journal of neurophysiology.

[15]  Michael J. Berry,et al.  Redundancy in the Population Code of the Retina , 2005, Neuron.

[16]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[17]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[18]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[19]  Iman H. Brivanlou,et al.  Mechanisms of Concerted Firing among Retinal Ganglion Cells , 1998, Neuron.

[20]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[21]  Gasper Tkacik,et al.  Optimizing information flow in small genetic networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Jonathon Shlens,et al.  The Structure of Large-Scale Synchronized Firing in Primate Retina , 2009, The Journal of Neuroscience.

[23]  Gašper Tkačik,et al.  Information flow in biological networks , 2007 .

[24]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[25]  M. Laubach,et al.  Redundancy and Synergy of Neuronal Ensembles in Motor Cortex , 2005, The Journal of Neuroscience.

[26]  J. H. van Hateren,et al.  A theory of maximizing sensory information , 2004, Biological Cybernetics.

[27]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[28]  Vijay Balasubramanian,et al.  Receptive fields and functional architecture in the retina , 2009, The Journal of physiology.

[29]  T. Sharpee,et al.  Predictable irregularities in retinal receptive fields , 2009, Proceedings of the National Academy of Sciences.

[30]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[31]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[32]  Ralph Linsker,et al.  An Application of the Principle of Maximum Information Preservation to Linear Systems , 1988, NIPS.

[33]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[34]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[35]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[36]  Charles P. Ratliff,et al.  Design of a Neuronal Array , 2008, The Journal of Neuroscience.

[37]  Michael J. Berry,et al.  Spin glass models for a network of real neurons , 2009, 0912.5409.

[38]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.