A context-free data compression approach to measuring information transmission by action potentials.

Action potentials allow nervous systems to transmit information rapidly and efficiently over considerable distances, but what is the information they carry and how much can be carried by one neuron? Often, qualitative and vague descriptions are used, such as the firing rate representing intensity. Recent attempts to quantify information transmission by action potentials have concentrated on treating neurons as communication channels, whose information capacity can be estimated from their signal-to-noise ratios. However, this only indicates how much information could theoretically be carried, not the actual amount at any given time, and the ratio itself depends on assumptions about information coding. Here we introduce a different approach based on the concept of data compression, which has become familiar with the widespread use of digital computers and networks. Compression takes advantage of redundancy in a sequence of numbers to reduce its size, but allows it to be reconstructed later without error. We show that data compression by a context-free grammar can quantitatively estimate the real information content of action potential signals without any prior assumptions about coding, or knowledge of neural inputs. Measurements of information coding by mechanosensory neurons are used as examples, but a major advantage of this approach is its generality. It can estimate information transmission by any neuron whose output can be measured, regardless of neuronal type, connectivity or function.

[1]  A. S. French Coherence Improvement in White Noise Analysis by the Use of a Repeated Random Sequence Generator , 1980, IEEE Transactions on Biomedical Engineering.

[2]  Vasilis Z. Marmarelis,et al.  Nonlinear Analysis of Neuronal Systems , 1999 .

[3]  W. Ebeling,et al.  On grammars, complexity, and information measures of biological macromolecules , 1980 .

[4]  W. McCulloch,et al.  The limiting information capacity of a neuronal link , 1952 .

[5]  A. S. French,et al.  The Efficiency of Sensory Information Coding by Mechanoreceptor Neurons , 1997, Neuron.

[6]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[7]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  Frank H. Eeckman,et al.  Analysis and Modeling of Neural Systems , 1992, Springer US.

[9]  M. Jiménez-Montaño,et al.  Measures of complexity in neural spike-trains of the slowly adapting stretch receptor organs. , 2000, Bio Systems.

[10]  Håkan Johansson,et al.  Modern Techniques in Neuroscience Research , 1999, Springer Berlin Heidelberg.

[11]  P. Rapp,et al.  The algorithmic complexity of neural spike trains increases during focal seizures , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Information transmission at 500 bits/s by action potentials in a mechanosensory neuron of the cockroach , 1998, Neuroscience Letters.

[13]  Julius S. Bendat,et al.  Engineering Applications of Correlation and Spectral Analysis , 1980 .

[14]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[15]  A. S. French,et al.  The frequency response, coherence, and information capacity of two neuronal models. , 1972, Biophysical journal.

[16]  S. Laughlin,et al.  The rate of information transfer at graded-potential synapses , 1996, Nature.

[17]  Andrew S. French,et al.  Frequency response functions and information capacities of paired spider mechanoreceptor neurons , 2001, Biological Cybernetics.

[18]  K. Naka,et al.  Dynamics of the ganglion cell response in the catfish and frog retinas , 1987, The Journal of general physiology.