Correlations and the encoding of information in the nervous system

Is the information transmitted by an ensemble of neurons determined solely by the number of spikes fired by each cell, or do correlations in the emission of action potentials also play a significant role? We derive a simple formula which enables this question to be answered rigorously for short time–scales. The formula quantifies the corrections to the instantaneous information rate which result from correlations in spike emission between pairs of neurons. The mutual information that the ensemble of neurons conveys about external stimuli can thus be broken down into firing rate and correlation components. This analysis provides fundamental constraints upon the nature of information coding, showing that over short time–scales, correlations cannot dominate information representation, that stimulus–independent correlations may lead to synergy (where the neurons together convey more information than they would if they were considered independently), but that only certain combinations of the different sources of correlation result in significant synergy rather than in redundancy or in negligible effects. This analysis leads to a new quantification procedure which is directly applicable to simultaneous multiple neuron recordings.

[1]  V. Mountcastle,et al.  NEURAL ACTIVITY IN MECHANORECEPTIVE CUTANEOUS AFFERENTS: STIMULUS-RESPONSE RELATIONS, WEBER FUNCTIONS, AND INFORMATION TRANSMISSION. , 1965, Journal of neurophysiology.

[2]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[3]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[4]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[5]  W. Singer,et al.  Neuronal assemblies: necessity, signature and detectability , 1997, Trends in Cognitive Sciences.

[6]  C. Malsburg Binding in models of perception and brain function , 1995, Current Opinion in Neurobiology.

[7]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[8]  D. Perrett,et al.  Time course of neural responses discriminating different views of the face and head. , 1992, Journal of neurophysiology.

[9]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[10]  Daniel J. Amit Is synchronization necessary and is it sufficient , 1997 .

[11]  D. Baylor,et al.  Concerted Signaling by Retinal Ganglion Cells , 1995, Science.

[12]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[13]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[14]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[15]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[16]  Claus C Hilgetag,et al.  Information processing: A solution to the binding problem? , 1996, Current Biology.

[17]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[18]  M. Konishi,et al.  A circuit for detection of interaural time differences in the brain stem of the barn owl , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[20]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[21]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[22]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  W. Singer,et al.  Synchronization of oscillatory neuronal responses in cat striate cortex: Temporal properties , 1992, Visual Neuroscience.

[24]  E. Rolls,et al.  Spatial View Cells in the Primate Hippocampus , 1997, The European journal of neuroscience.

[25]  J. Hertz,et al.  Adjacent visual cortical complex cells share about 20% of their stimulus-related information. , 1996, Cerebral cortex.

[26]  J. Donoghue,et al.  Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. , 1998, Journal of neurophysiology.

[27]  C E Carr,et al.  Processing of temporal information in the brain. , 1993, Annual review of neuroscience.

[28]  J. G. Taylor,et al.  Neural Networks and the Brain , 1974 .

[29]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[30]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[31]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.

[32]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[33]  E. Fetz,et al.  Synchronization of neurons during local field potential oscillations in sensorimotor cortex of awake monkeys. , 1996, Journal of neurophysiology.

[34]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[35]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[36]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[37]  C. von der Malsburg Binding in models of perception and brain function. , 1995, Current opinion in neurobiology.

[38]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[39]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[40]  M. Livingstone,et al.  Neuronal correlates of visibility and invisibility in the primate visual system , 1998, Nature Neuroscience.

[41]  Bruce L. McNaughton,et al.  An Information-Theoretic Approach to Deciphering the Hippocampal Code , 1992, NIPS.

[42]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.