On pooling networks and fluctuation in suboptimal detection framework

Motivated by biological neural networks and distributed sensing networks, we study how pooling networks – or quantizers – with random thresholds can be used in detection tasks. We provide a brief overview of the use of deterministic quantizers in detection by presenting how quantizers can be optimally designed for detection purposes. We study the behavior of these networks when they are used in a problem for which they are not optimal (mismatching). We show that adding random fluctuations to the thresholds of the networks can then enhance the performance of the quantizers, thus helping in the recovery of "a kind of" optimality. We also show that (for a small number of thresholds) it suffices to use random uniform quantizers, for which we provide a study of the behavior as a function of several parameters (size, fluctuation nature, observation noise nature). The conclusion to these studies are the robustness of the uniform quantizer used as a detector with respect to fluctuations added on its thresholds.

[1]  James A. Bucklew,et al.  Multidimensional digitization of data followed by a mapping , 1984, IEEE Trans. Inf. Theory.

[2]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[3]  H. Poor,et al.  Fine quantization in signal detection and estimation , 1988, IEEE Trans. Inf. Theory.

[4]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[5]  Haralabos C. Papadopoulos,et al.  Sequential signal encoding from noisy measurements using quantizers with dynamic bias control , 2001, IEEE Trans. Inf. Theory.

[6]  Gerald R. Benitz,et al.  Asymptotically optimal quantizers for detection of I.I.D. data , 1989, IEEE Trans. Inf. Theory.

[7]  H. V. Poor,et al.  Applications of Ali-Silvey Distance Measures in the Design of Generalized Quantizers for Binary Decision Systems , 1977, IEEE Trans. Commun..

[8]  S. Graf,et al.  Foundations of Quantization for Probability Distributions , 2000 .

[9]  R. Gregory.  Eye and Brain: The Psychology of Seeing , 1969 .

[10]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[11]  Vijay K. Madisetti,et al.  The Digital Signal Processing Handbook , 1997 .

[12]  Bulsara,et al.  Threshold detection of wideband signals: A noise-induced maximum in the mutual information. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[13]  Bernd-Peter Paris,et al.  On the relationship between measures of discrimination and the performance of suboptimal detectors , 1995, IEEE Trans. Inf. Theory.

[14]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[15]  Ludwik Kurz,et al.  Nonparametric detectors based on m-interval partitioning , 1972, IEEE Trans. Inf. Theory.

[16]  Alejandro Ribeiro,et al.  Bandwidth-constrained distributed estimation for wireless sensor Networks-part I: Gaussian case , 2006, IEEE Transactions on Signal Processing.

[17]  N G Stocks,et al.  Information transmission in parallel threshold arrays: suprathreshold stochastic resonance. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Saleem A. Kassam,et al.  Optimum Quantization for Signal Detection , 1977, IEEE Trans. Commun..

[19]  Olivier J. J. Michel,et al.  Networks of the Pooling Type and Optimal Quantization , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[20]  F. Chapeau-Blondeau.  Nonlinear test statistic to improve signal detection in non-Gaussian noise , 2000, IEEE Signal Processing Letters.

[21]  N. Stocks,et al.  Suprathreshold stochastic resonance in multilevel threshold systems , 2000, Physical review letters.

[22]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[23]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  V. Anderson.  Digital Array Phasing , 1959 .

[25]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[26]  Philip Rudnick,et al.  Small Signal Detection in the DIMUS Array , 1960 .

[27]  Vincenzo Galdi,et al.  Evaluation of stochastic-resonance-based detectors of weak harmonic signals in additive white Gaussian noise , 1998 .

[28]  Pierre-Olivier Amblard,et al.  On the use of stochastic resonance in sine detection , 2002, Signal Process..

[29]  Frank Jülicher,et al.  Active hair-bundle motility harnesses noise to operate near an optimum of mechanosensitivity. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Peter Hänggi,et al.  Stochastic resonance in biology. How noise can enhance detection of weak signals and help improve biological information processing. , 2002, Chemphyschem : a European journal of chemical physics and physical chemistry.

[31]  Patrick Duvaut,et al.  Optimum quantization for detection , 1988, IEEE Trans. Commun..

[32]  M. Taqqu,et al.  Stable Non-Gaussian Random Processes : Stochastic Models with Infinite Variance , 1995 .

[33]  S. Kay,et al.  Can detectability be improved by adding noise? , 2000, IEEE Signal Processing Letters.

[34]  A. Destexhe,et al.  Synaptic background activity controls spike transfer from thalamus to cortex , 2005, Nature Neuroscience.

[35]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[36]  H. Vincent Poor,et al.  On Optimum and Nearly Optimum Data Quantization for Signal Detection , 1984, IEEE Trans. Commun..

[37]  K. Obermayer,et al.  Optimal noise-aided signal transmission through populations of neurons. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.