How Well Can We Estimate the Information Carried in Neuronal Responses from Limited Samples?

It is difficult to extract the information carried by neuronal responses about a set of stimuli because limited data samples result in biased es timates. Recently two improved procedures have been developed to calculate information from experimental results: a binning-and-correcting procedure and a neural network procedure. We have used data produced from a model of the spatiotemporal receptive fields of parvocellular and magnocellular lateral geniculate neurons to study the performance of these methods as a function of the number of trials used. Both procedures yield accurate results for one-dimensional neuronal codes. They can also be used to produce a reasonable estimate of the extra information in a three-dimensional code, in this instance, within 0.05-0.1 bit of the asymptotically calculated valueabout 10 of the total transmitted information. We believe that this performance is much more accurate than previous procedures.

[1]  B J Richmond,et al.  Using response models to study coding strategies in monkey visual cortex. , 1998, Bio Systems.

[2]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[3]  Fred Rieke,et al.  Coding Efficiency and Information Rates in Sensory Neurons , 1993 .

[4]  B J Richmond,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. II. Quantification of response waveform. , 1987, Journal of neurophysiology.

[5]  Stefano Panzeri,et al.  The Upward Bias in Measures of Information Derived from Limited Data Samples , 1995, Neural Computation.

[6]  M. Tovée,et al.  Representational capacity of face coding in monkeys. , 1996, Cerebral cortex.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[9]  S. Laughlin,et al.  The rate of information transfer at graded-potential synapses , 1996, Nature.

[10]  A. Carlton.  On the bias of information estimates. , 1969 .

[11]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[12]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[14]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.

[15]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[16]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[17]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[18]  Ga Miller,et al.  Note on the bias of information estimates , 1955 .

[19]  Jonathan D. Victor,et al.  Sensory Coding in Cortical Neurons , 1997 .

[20]  R. Shapley,et al.  Spatial structure of cone inputs to receptive fields in primate lateral geniculate nucleus , 1992, Nature.

[21]  William Bialek,et al.  Optimal Real-Time Signal Processing in the Nervous System , 1993 .

[22]  D. Kleinfeld,et al.  On temporal codes and the spatiotemporal response of neurons in the lateral geniculate nucleus. , 1994, Journal of neurophysiology.

[23]  B J Richmond,et al.  Concurrent processing and complexity of temporally encoded neuronal messages in visual perception. , 1991, Science.

[24]  William Bialek,et al.  Princeton Lectures on Biophysics , 1993 .

[25]  Emad N. Eskandar,et al.  Measuring Natural Neural Processing with Artificial Neural Networks , 1992, Int. J. Neural Syst..