Capacity of a Single Spiking Neuron Channel

Information transfer through a single neuron is a fundamental component of information processing in the brain, and computing the information channel capacity is important to understand this information processing. The problem is difficult since the capacity depends on coding, characteristics of the communication channel, and optimization over input distributions, among other issues. In this letter, we consider two models. The temporal coding model of a neuron as a communication channel assumes the output is where is a gamma-distributed random variable corresponding to the interspike interval, that is, the time it takes for the neuron to fire once. The rate coding model is similar; the output is the actual rate of firing over a fixed period of time. Theoretical studies prove that the distribution of inputs, which achieves channel capacity, is a discrete distribution with finite mass points for temporal and rate coding under a reasonable assumption. This allows us to compute numerically the capacity of a neuron. Numerical results are in a plausible range based on biological evidence to date.

[1]  R. Stein,et al.  The information capacity of nerve cells using a frequency code. , 1967, Biophysical journal.

[2]  Mark D McDonnell,et al.  Neural population coding is optimized by discrete tuning curves. , 2008, Physical review letters.

[3]  Masato Okada,et al.  Estimating Spiking Irregularities Under Changing Environments , 2006, Neural Computation.

[4]  Shigeru Shinomoto,et al.  Differences in Spiking Patterns Among Cortical Neurons , 2003, Neural Computation.

[5]  N. Akhiezer,et al.  The Classical Moment Problem. , 1968 .

[6]  Lubomir Kostal,et al.  Information capacity in the weak-signal approximation , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  H. Vincent Poor,et al.  The Capacity of the Noncoherent Rician Fading Channel∗ , 2004 .

[8]  M. McDonnell,et al.  Maximally informative stimuli and tuning curves for sigmoidal rate-coding neurons and populations. , 2008, Physical review letters.

[9]  Anatol Rapoport,et al.  The Theoretical Channel Capacity of a Single Neuron as Determined by Various Coding Systems , 1960, Inf. Control..

[10]  H. Tamura,et al.  Regional and laminar differences in in vivo firing patterns of primate cortical neurons. , 2005, Journal of neurophysiology.

[11]  J. K. Hunter,et al.  Measure Theory , 2007 .

[12]  Shiro Ikeda,et al.  Capacity of a single spiking neuron , 2009 .

[13]  R N Lemon,et al.  Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance levels. , 2000, Journal of neurophysiology.

[14]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[15]  Ibrahim C. Abou-Faycal,et al.  The capacity of discrete-time memoryless Rayleigh-fading channels , 2001, IEEE Trans. Inf. Theory.

[16]  Shlomo Shamai,et al.  Mutual Information and Conditional Mean Estimation in Poisson Channels , 2004, IEEE Transactions on Information Theory.

[17]  Rufin van Rullen,et al.  Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex , 2001, Neural Computation.

[18]  Joel G. Smith,et al.  The Information Capacity of Amplitude- and Variance-Constrained Scalar Gaussian Channels , 1971, Inf. Control..

[19]  Petr Lánský,et al.  Information transfer with small-amplitude signals , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  S. Shamai,et al.  Capacity of a pulse amplitude modulated direct detection photon channel , 1990 .

[21]  Mark D. McDonnell,et al.  The role of stochasticity in an information-optimal neural population code , 2009 .

[22]  Israel Bar-David,et al.  Communication under the Poisson regime , 1969, IEEE Trans. Inf. Theory.

[23]  Aslan Tchamkerten,et al.  On the discreteness of capacity-achieving distributions , 2004, IEEE Transactions on Information Theory.

[24]  H. Vincent Poor,et al.  The noncoherent rician fading Channel-part I: structure of the capacity-achieving input , 2005, IEEE Transactions on Wireless Communications.

[25]  S. Verdú.  Poisson Communication Theory , 2004 .

[26]  Toby Berger,et al.  Information transfer by energy-efficient neurons , 2009, 2009 IEEE International Symposium on Information Theory.

[27]  Toby Berger,et al.  A Mathematical Theory of Energy Efficient Neural Computation and Communication , 2010, IEEE Transactions on Information Theory.

[28]  W. McCulloch,et al.  The limiting information capacity of a neuronal link , 1952 .

[29]  Petr Lánský,et al.  Parameters of Spike Trains Observed in a Short Time Window , 2008, Neural Computation.

[30]  Kazushi Ikeda.  Information Geometry of Interspike Intervals in Spiking Neurons , 2005, Neural Computation.

[31]  K. Do,et al.  Efficient and Adaptive Estimation for Semiparametric Models. , 1994 .

[32]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[33]  P. Bickel.  Efficient and Adaptive Estimation for Semiparametric Models , 1993 .

[34]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[35]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .