Optimising threshold levels for information transmission in binary threshold networks: Independent multiplicative noise on each threshold

The problem of optimising the threshold levels in multilevel threshold system subject to multiplicative Gaussian and uniform noise is considered. Similar to previous results for additive noise, we find a bifurcation phenomenon in the optimal threshold values, as the noise intensity changes. This occurs when the number of threshold units is greater than one. We also study the optimal thresholds for combined additive and multiplicative Gaussian noise, and find that all threshold levels need to be identical to optimise the system when the additive noise intensity is a constant. However, this identical value is not equal to the signal mean, unlike the case of additive noise. When the multiplicative noise intensity is instead held constant, the optimal threshold levels are not all identical for small additive noise intensity but are all equal to zero for large additive noise intensity. The model and our results are potentially relevant for sensor network design and understanding neurobiological sensory neurons such as in the peripheral auditory system.

[1]  P. Hänggi,et al.  Quantum stochastic resonance in symmetric systems. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Gregoire Nicolis,et al.  Stochastic resonance , 2007, Scholarpedia.

[3]  Lenan Wu,et al.  STOCHASTIC RESONANCE AND NOISE-ENHANCED FISHER INFORMATION , 2005 .

[4]  Mark D McDonnell,et al.  Information capacity of stochastic pooling networks is achieved by discrete inputs. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Klaus Obermayer,et al.  Adaptation using local information for maximizing the global cost , 2003, Neurocomputing.

[6]  R P Morse,et al.  Enhanced information transmission with signal-dependent noise in an array of nonlinear elements. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  François Chapeau-Blondeau,et al.  Suprathreshold stochastic resonance and noise-enhanced Fisher information in arrays of threshold devices. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Kurths,et al.  Doubly stochastic resonance , 2000, Physical review letters.

[9]  François Chapeau-Blondeau,et al.  Noise-enhanced nonlinear detector to improve signal detection in non-Gaussian noise , 2006 .

[10]  Henry C. Tuckwell,et al.  Analysis of inverse stochastic resonance and the long-term firing of Hodgkin–Huxley neurons with Gaussian white noise , 2012, 1202.2491.

[11]  Jia,et al.  Stochastic resonance in a bistable system subject to multiplicative and additive noise , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[12]  N. Stocks,et al.  Suprathreshold stochastic resonance in multilevel threshold systems , 2000, Physical review letters.

[13]  Catherine Nicolis,et al.  Stochastic aspects of climatic transitions—response to a periodic forcing , 1982 .

[14]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Jinqiao Duan,et al.  Lévy noise-induced stochastic resonance in a bistable system , 2012, 1207.3939.

[16]  Derek Abbott,et al.  What Is Stochastic Resonance? Definitions, Misconceptions, Debates, and Its Relevance to Biology , 2009, PLoS Comput. Biol..

[17]  François Chapeau-Blondeau,et al.  Noise enhancement of signal transduction by parallel arrays of nonlinear neurons with threshold and saturation , 2007, Neurocomputing.

[18]  Y. Lai,et al.  Noise sensitivity of phase-synchronization time in stochastic resonance: theory and experiment. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Carson C. Chow,et al.  Aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  A. Sutera,et al.  The mechanism of stochastic resonance , 1981 .

[21]  Chris Eliasmith,et al.  The Competing Benefits of Noise and Heterogeneity in Neural Coding , 2014, Neural Computation.

[22]  P. Landa,et al.  Theory of stochastic resonance for small signals in weakly damped bistable oscillators. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Mark D. McDonnell,et al.  Channel-noise-induced stochastic facilitation in an auditory brainstem neuron model. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Jianfeng Feng,et al.  Suprathreshold stochastic resonance in neural processing tuned by correlation. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Jianguo Tan,et al.  Suprathreshold stochastic resonance in multilevel threshold system driven by multiplicative and additive noises , 2013, Commun. Nonlinear Sci. Numer. Simul..

[26]  Albert E. Parker,et al.  SYMMETRY BREAKING BIFURCATIONS OF THE INFORMATION DISTORTION , 2003 .

[27]  David Allingham,et al.  THE APPLICATION OF SUPRATHRESHOLD STOCHASTIC RESONANCE TO COCHLEAR IMPLANT CODING , 2002, The Random and Fluctuating World.

[28]  K. Obermayer,et al.  Optimal noise-aided signal transmission through populations of neurons. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Tomás Gedeon,et al.  The Mathematical Structure of Information Bottleneck Methods , 2012, Entropy.

[30]  Nigel G. Stocks,et al.  Suprathreshold stochastic resonance: an exact result for uniformly distributed signal and noise , 2001 .

[31]  N G Stocks,et al.  Information transmission in parallel threshold arrays: suprathreshold stochastic resonance. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Ya Jia,et al.  Effects of colored noise on stochastic resonance in a bistable system subject to multiplicative and additive noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  H. Hasegawa.  Stochastic resonance in bistable systems with nonlinear dissipation and multiplicative noise: A microscopic approach , 2012, 1203.0770.

[34]  C. Pearce,et al.  Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantization , 2008 .

[35]  P. Hänggi,et al.  Non-Markovian stochastic resonance. , 2003, Physical review letters.

[36]  François Chapeau-Blondeau,et al.  Suprathreshold stochastic resonance and signal-to-noise ratio improvement in arrays of comparators [rapid communication] , 2004 .

[37]  Masayoshi Kubo,et al.  Suprathreshold stochastic resonance induced by ion channel fluctuation , 2010 .

[38]  Mark D. McDonnell,et al.  Stochastic pooling networks , 2009, 0901.3644.

[39]  Derek Abbott,et al.  An analysis of noise enhanced information transmission in an array of comparators , 2002 .

[40]  Derek Abbott,et al.  Optimal information transmission in nonlinear arrays through suprathreshold stochastic resonance , 2006 .

[41]  M. R. Spiegel.  Mathematical handbook of formulas and tables , 1968 .