Energy-Efficient Coding with Discrete Stochastic Events

We investigate the energy efficiency of signaling mechanisms that transfer information by means of discrete stochastic events, such as the opening or closing of an ion channel. Using a simple model for the generation of graded electrical signals by sodium and potassium channels, we find optimum numbers of channels that maximize energy efficiency. The optima depend on several factors: the relative magnitudes of the signaling cost (current flow through channels), the fixed cost of maintaining the system, the reliability of the input, additional sources of noise, and the relative costs of upstream and downstream mechanisms. We also analyze how the statistics of input signals influence energy efficiency. We find that energy-efficient signal ensembles favor a bimodal distribution of channel activations and contain only a very small fraction of large inputs when energy is scarce. We conclude that when energy use is a significant constraint, trade-offs between information transfer and energy can strongly influence the number of signaling molecules and synapses used by neurons and the manner in which these mechanisms represent information.

[1]  G D Lewen,et al.  Reproducibility and Variability in Neural Spike Trains , 1997, Science.

[2]  Suguru Arimoto,et al.  An algorithm for computing the capacity of arbitrary discrete memoryless channels , 1972, IEEE Trans. Inf. Theory.

[3]  S. Laughlin.  A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[4]  J. White,et al.  Channel noise in neurons , 2000, Trends in Neurosciences.

[5]  Manfred Kern,et al.  Metabolic rate of the insect brain in relation to body size and phylogeny , 1985 .

[6]  K. Obermayer,et al.  Optimal noise-aided signal transmission through populations of neurons. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  S. Laughlin,et al.  Photoreceptor performance and the co-ordination of achromatic and chromatic inputs in the fly visual system , 2000, Vision Research.

[8]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[9]  Rahul Sarpeshkar,et al.  Analog Versus Digital: Extrapolating from Electronics to Neurobiology , 1998, Neural Computation.

[10]  S. Laughlin.  Matching coding, circuits, cells, and molecules to signals: General principles of retinal design in the fly's eye , 1994, Progress in Retinal and Eye Research.

[11]  G. Brown,et al.  Cellular energy utilization and molecular origin of standard metabolic rate in mammals. , 1997, Physiological reviews.

[12]  L. Aiello,et al.  The Expensive-Tissue Hypothesis: The Brain and the Digestive System in Human and Primate Evolution , 1995, Current Anthropology.

[13]  R. M. Alexander,et al.  A theory of mixed chains applied to safety factors in biological systems. , 1997, Journal of theoretical biology.

[14]  Richard E. Blahut,et al.  Computation of channel capacity and rate-distortion functions , 1972, IEEE Trans. Inf. Theory.

[15]  K. Nagata.  [Brain energy metabolism]. , 1997, Nihon rinsho. Japanese journal of clinical medicine.

[16]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[17]  R. Martin.  Scaling of the Mammalian Brain: the Maternal Energy Hypothesis , 1996 .

[18]  B. Siesjö,et al.  Brain energy metabolism , 1978 .

[19]  A. Zador.  Impact of synaptic unreliability on the information transmitted by spiking neurons. , 1998, Journal of neurophysiology.

[20]  Rob R. de Ruyter van Steveninck,et al.  The metabolic cost of neural information , 1998, Nature Neuroscience.

[21]  G. Nilsson,et al.  Brain and body oxygen requirements of Gnathonemus petersii, a fish with an exceptionally large brain , 1996, The Journal of experimental biology.

[22]  Peter L. Lutz,et al.  The Brain Without Oxygen , 2002, Springer Netherlands.

[23]  Andreas G. Andreou,et al.  Capacity and energy cost of information in biological and silicon photoreceptors , 2001, Proc. IEEE.

[24]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[25]  Michael J. Berry,et al.  A test of metabolically efficient coding in the retina , 2002, Network.

[26]  Wulfila Gronenberg,et al.  Smaller Brains and Optic Lobes in Reproductive Workers of the Ant Harpegnathos , 1999, Naturwissenschaften.

[27]  Andreas G. Andreou,et al.  Relating information capacity to a biophysical model for blowfly photoreceptors , 2000, Neurocomputing.

[28]  Simon Laughlin,et al.  The reliability of single neurons and circuit design: a case study , 1989 .

[29]  Rob R. de Ruyter van Steveninck,et al.  Coding Efficiency and the Metabolic Cost of Sensory and Neural Information , 2000, Information Theory and the Brain.

[30]  S. Laughlin.  Energy as a constraint on the coding and processing of sensory information , 2001, Current Opinion in Neurobiology.

[31]  G. Garcia de Polavieja.  Errors Drive the Evolution of Biological Signalling to Costly Codes , 2001 .

[32]  Gonzalo G de Polavieja.  Errors drive the evolution of biological signalling to costly codes. , 2002, Journal of theoretical biology.

[33]  Michael J. Berry,et al.  Metabolically Efficient Information Processing , 2001, Neural Computation.

[34]  Adelbert Ames,et al.  CNS energy metabolism as related to function , 2000, Brain Research Reviews.

[35]  William B. Levy,et al.  Energy Efficient Neural Codes , 1996, Neural Computation.