Information capacity of stochastic pooling networks is achieved by discrete inputs.

Stochastic pooling networks (SPN) are sensor networks where multiple sensors make independently noisy and compressed measurements of the same information source, which are combined via pooling. Examples of SPNs range from nanoelectronics to biological sensory neurons. Here it is shown that optimal information transmission in SPNs with nodes that quantize to a finite number of states requires the input signal distribution to be discrete. This is illustrated numerically for a simple SPN consisting of N binary-quantizing sensors. The resultant information capacity is shown to be independent of the noise distribution when the signal distribution can be freely chosen, but to imply an optimal noise distribution if the signal distribution is fixed. While larger than the best performance of previously studied continuously valued input signals, the capacity does not scale faster than the previous best result of log_{2}(sqrt[N]) bits per channel use. It is also shown that a plot of the optimal input distribution contains bifurcations as N increases, and that suprathreshold stochastic resonance occurs when the mutual information is determined for a suboptimal noise distribution.

[1]  B. Kosko,et al.  Robust stochastic resonance: signal detection and adaptation in impulsive noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Antonio Rubio,et al.  Cell architecture for nanoelectronic design , 2007, Microelectron. J..

[3]  S. Shamai,et al.  Capacity of a pulse amplitude modulated direct detection photon channel , 1990 .

[4]  N. Stocks,et al.  Suprathreshold stochastic resonance in multilevel threshold systems , 2000, Physical review letters.

[5]  N G Stocks,et al.  Information transmission in parallel threshold arrays: suprathreshold stochastic resonance. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Ilan N Goodman,et al.  Inferring the capacity of the vector Poisson channel with a Bernoulli model , 2008, Network.

[7]  Mark D. McDonnell,et al.  Stochastic pooling networks , 2009, 0901.3644.

[8]  Derek Abbott,et al.  An analysis of noise enhanced information transmission in an array of comparators , 2002 .

[9]  Frank R. Kschischang,et al.  Capacity-achieving probability measure for conditionally Gaussian channels with bounded inputs , 2005, IEEE Transactions on Information Theory.

[10]  Pierre-Olivier Amblard,et al.  On pooling networks and fluctuation in suboptimal detection framework , 2007 .

[11]  Bulsara,et al.  Threshold detection of wideband signals: A noise-induced maximum in the mutual information. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[12]  Nigel G. Stocks,et al.  Suprathreshold stochastic resonance: an exact result for uniformly distributed signal and noise , 2001 .

[13]  R. Stein,et al.  The information capacity of nerve cells using a frequency code. , 1967, Biophysical journal.

[14]  Carson C. Chow,et al.  Aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[15]  R P Morse,et al.  Enhanced information transmission with signal-dependent noise in an array of nonlinear elements. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Bart Kosko,et al.  Robust stochastic resonance for simple threshold neurons. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Y. Kabanov The Capacity of a Channel of the Poisson Type , 1978 .

[18]  Stephen P. Boyd,et al.  Geometric programming duals of channel capacity and rate distortion , 2004, IEEE Transactions on Information Theory.

[19]  M. Diamond,et al.  Decoding neuronal population activity in rat somatosensory cortex: role of columnar organization. , 2003, Cerebral cortex.

[20]  François Chapeau-Blondeau,et al.  Constructive role of noise in signal detection from parallel arrays of quantizers , 2005, Signal Process..

[21]  François Chapeau-Blondeau,et al.  Suprathreshold stochastic resonance and noise-enhanced Fisher information in arrays of threshold devices. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  F. Chapeau-Blondeau,et al.  Stochastic resonance for nonlinear sensors with saturation. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Derek Abbott,et al.  Optimal stimulus and noise distributions for information transmission via suprathreshold stochastic resonance. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Teich,et al.  Information measures quantifying aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[25]  Derek Abbott,et al.  Optimal information transmission in nonlinear arrays through suprathreshold stochastic resonance , 2006 .

[26]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Vladimir J. Lumelsky,et al.  Robust Data-Optimized Stochastic Analog-to-Digital Converters , 2007, IEEE Transactions on Signal Processing.

[28]  K. Obermayer,et al.  Optimal noise-aided signal transmission through populations of neurons. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Ashok Patel,et al.  Stochastic resonance in noisy spiking retinal and sensory neuron models , 2005, Neural Networks.