Optimal quantization for energy-efficient information transfer in a population of neuron-like devices

Suprathreshold Stochastic Resonance (SSR) is a recently discovered form of stochastic resonance that occurs in populations of neuron-like devices. A key feature of SSR is that all devices in the population possess identical threshold nonlinearities. It has previously been shown that information transmission through such a system is optimized by nonzero internal noise. It is also clear that it is desirable for the brain to transfer information in an energy efficient manner. In this paper we discuss the energy efficient maximization of information transmission for the case of variable thresholds and constraints imposed on the energy available to the system, as well as minimization of energy for the case of a fixed information rate. We aim to demonstrate that under certain conditions, the SSR configuration of all devices having identical thresholds is optimal. The novel feature of this work is that optimization is performed by finding the optimal threshold settings for the population of devices, which is equivalent to solving a noisy optimal quantization problem.

[1]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[2]  N G Stocks,et al.  Information transmission in parallel threshold arrays: suprathreshold stochastic resonance. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Derek Abbott,et al.  An analysis of noise enhanced information transmission in an array of comparators , 2002 .

[4]  Derek Abbott,et al.  Point singularities and suprathreshold stochastic resonance in optimal coding , 2004 .

[5]  William Bialek,et al.  Bits and brains: Information flow in the nervous system , 1993 .

[6]  Matthias Bethge,et al.  Optimal Short-Term Population Coding: When Fisher Information Fails , 2002, Neural Computation.

[7]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[8]  Klaus Obermayer,et al.  Adaptation using local information for maximizing the global cost , 2003, Neurocomputing.

[9]  Nigel G. Stocks,et al.  Suprathreshold stochastic resonance: an exact result for uniformly distributed signal and noise , 2001 .

[10]  K. Obermayer,et al.  Optimal noise-aided signal transmission through populations of neurons. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Michael J. Berry,et al.  Metabolically Efficient Information Processing , 2001, Neural Computation.

[12]  Derek Abbott,et al.  A characterization of suprathreshold stochastic resonance in an array of comparators by correlation coefficient , 2002 .

[13]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[14]  Frank Moss,et al.  Stochastic resonance: noise-enhanced order , 1999 .

[15]  Derek Abbott,et al.  Overview: Unsolved problems of noise and fluctuations. , 2001, Chaos.

[16]  N. Stocks,et al.  Suprathreshold stochastic resonance in multilevel threshold systems , 2000, Physical review letters.

[17]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Chris Eliasmith,et al.  Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems , 2004, IEEE Transactions on Neural Networks.

[19]  William B Levy,et al.  Energy-Efficient Neuronal Computation via Quantal Synaptic Failures , 2002, The Journal of Neuroscience.

[20]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[21]  Christian W. Eurich,et al.  Representational Accuracy of Stochastic Neural Populations , 2002, Neural Computation.

[22]  François Chapeau-Blondeau,et al.  Suprathreshold stochastic resonance and noise-enhanced Fisher information in arrays of threshold devices. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Simon B. Laughlin,et al.  Energy-Efficient Coding with Discrete Stochastic Events , 2002, Neural Computation.

[24]  S. Laughlin Energy as a constraint on the coding and processing of sensory information , 2001, Current Opinion in Neurobiology.

[25]  A. Longtin Stochastic resonance in neuron models , 1993 .