Mismatched Decoding in the Brain

“How is information decoded in the brain?” is one of the most difficult and important questions in neuroscience. We have developed a general framework for investigating to what extent the decoding process in the brain can be simplified. First, we hierarchically constructed simplified probabilistic models of neural responses that ignore more than Kth-order correlations using the maximum entropy principle. We then computed how much information is lost when information is decoded using these simplified probabilistic models (i.e., “mismatched decoders”). To evaluate the information obtained by mismatched decoders, we introduced an information theoretic quantity, I*, which was derived by extending the mutual information in terms of communication rate across a channel. We showed that I* provides consistent results with the minimum mean-square error as well as the mutual information, and demonstrated that a previously proposed measure quantifying the importance of correlations in decoding substantially deviates from I* when many cells are analyzed. We then applied this proposed framework to spike data for vertebrate retina using short natural scene movies of 100 ms duration as a set of stimuli and computing the information contained in neural activities. Although significant correlations were observed in population activities of ganglion cells, information loss was negligibly small even if all orders of correlation were ignored in decoding. We also found that, if we inappropriately assumed stationarity for long durations in the information analysis of dynamically changing stimuli, such as natural scene movies, correlations appear to carry a large proportion of total information regardless of their actual importance.

[1]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[2]  Shlomo Shamai,et al.  On information rates for mismatched decoders , 1994, IEEE Trans. Inf. Theory.

[3]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[4]  M. Paradiso,et al.  A theory for the use of visual orientation information which exploits the columnar structure of striate cortex , 2004, Biological Cybernetics.

[5]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[6]  M. Tachibana,et al.  Synchronized retinal oscillations encode essential information for escape behavior in frogs , 2005, Nature Neuroscience.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  M. Diamond,et al.  The Role of Spike Timing in the Coding of Stimulus Location in Rat Somatosensory Cortex , 2001, Neuron.

[9]  Shun-ichi Amari,et al.  Correlation and Independence in the Neural Code , 2006, Neural Computation.

[10]  Sami El Boustani,et al.  Prediction of spatiotemporal patterns of neural activity from pairwise correlations. , 2009, Physical review letters.

[11]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[12]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[13]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[14]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[15]  Stefano Panzeri,et al.  The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[16]  P. Latham,et al.  Retinal ganglion cells act largely as independent encoders , 2001, Nature.

[17]  M. A. Smith,et al.  The Role of Correlations in Direction and Contrast Coding in the Primary Visual Cortex , 2007, The Journal of Neuroscience.

[18]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[19]  Michael J. Berry,et al.  Network information and connected correlations. , 2003, Physical review letters.

[20]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[21]  F. Mechler,et al.  Temporal coding of contrast in primary visual cortex: when, what, and why. , 2001, Journal of neurophysiology.

[22]  G. Laurent,et al.  Impaired odour discrimination on desynchronization of odour-encoding neural assemblies , 1997, Nature.

[23]  Y. Dan,et al.  Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus , 1998, Nature Neuroscience.

[24]  Shun-ichi Amari,et al.  Information-Geometric Measure for Neural Spikes , 2002, Neural Computation.

[25]  Markus Meister,et al.  Multi-neuronal signals from the retina: acquisition and analysis , 1994, Journal of Neuroscience Methods.

[26]  Masato Okada,et al.  A general framework for investigating how far the decoding process in the brain can be simplified , 2008, NIPS.

[27]  Glenn C. Turner,et al.  Oscillations and Sparsening of Odor Representations in the Mushroom Body , 2002, Science.

[28]  V. Hateren,et al.  Processing of natural time series of intensities by the visual system of the blowfly , 1997, Vision Research.

[29]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[30]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[32]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.

[33]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[34]  J J Hopfield,et al.  Odor space and olfactory processing: collective algorithms and neural implementation. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Carlos D. Brody,et al.  Simple Networks for Spike-Timing-Based Computation, with Application to Olfactory Processing , 2003, Neuron.

[36]  M. Meister.  Multineuronal codes in retinal signaling. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[38]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[39]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[40]  Marcelo A. Montemurro,et al.  Tight Data-Robust Bounds to Mutual Information Combining Shuffling and Model Selection Techniques , 2007, Neural Computation.

[41]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[42]  Valentin Dragoi,et al.  Adaptive coding of visual information in neural populations , 2008, Nature.

[43]  S. Panzeri,et al.  An exact method to quantify the information transmitted by different mechanisms of correlational coding. , 2003, Network.

[44]  M. Young,et al.  Correlations, feature‐binding and population coding in primary visual cortex , 2003, Neuroreport.

[45]  D. Baylor,et al.  Concerted Signaling by Retinal Ganglion Cells , 1995, Science.