Noise-exploitation and adaptation in neuromorphic sensors

Even though current micro-nano fabrication technology has reached integration levels where ultra-sensitive sensors can be fabricated, the sensing performance (resolution per joule) of synthetic systems are still orders of magnitude inferior to those observed in neurobiology. For example, the filiform hairs in crickets operate at fundamental limits of noise; auditory sensors in a parasitoid fly can overcome fundamental limitations to precisely localize ultra-faint acoustic signatures. Even though many of these biological marvels have served as inspiration for different types of neuromorphic sensors, the main focus these designs have been to faithfully replicate the biological functionalities, without considering the constructive role of "noise". In man-made sensors device and sensor noise are typically considered as a nuisance, where as in neurobiology "noise" has been shown to be a computational aid that enables biology to sense and operate at fundamental limits of energy efficiency and performance. In this paper, we describe some of the important noise-exploitation and adaptation principles observed in neurobiology and how they can be systematically used for designing neuromorphic sensors. Our focus will be on two types of noise-exploitation principles, namely, (a) stochastic resonance; and (b) noise-shaping, which are unified within our previously reported framework called Σ▵ learning. As a case-study, we describe the application of Σ▵ learning for the design of a miniature acoustic source localizer whose performance matches that of its biological counterpart(Ormia Ochracea).

[1]  J. White,et al.  Channel noise in neurons , 2000, Trends in Neurosciences.

[2]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[3]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[4]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[5]  Bulsara,et al.  Time-interval sequences in bistable systems and the noise-induced transmission of information by sensory neurons. , 1991, Physical review letters.

[6]  Maurice J. Chacron,et al.  Experimental and theoretical demonstration of noise shaping by interspike interval correlations (Invited Paper) , 2005, SPIE International Symposium on Fluctuations and Noise.

[7]  Mark E Nelson,et al.  Omnidirectional Sensory and Motor Volumes in Electric Fish , 2007, PLoS biology.

[8]  Kelvin E. Jones,et al.  Neuronal variability: noise or part of the signal? , 2005, Nature Reviews Neuroscience.

[9]  Cristina Masoller,et al.  Detecting and quantifying stochastic and coherence resonances via information-theory complexity measurements. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[11]  Gert Cauwenberghs,et al.  Micropower gradient flow acoustic localizer , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  Minh N. Do Toward sound-based synthesis: the far-field case , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Mark E. Nelson,et al.  Biological smart sensing strategies in weakly electric fish , 2011 .

[14]  G. Ermentrout,et al.  Reliability, synchrony and noise , 2008, Trends in Neurosciences.

[15]  Fabrizio Gabbiani,et al.  Burst firing in sensory systems , 2004, Nature Reviews Neuroscience.

[16]  Shih-Chii Liu,et al.  Neuromorphic sensory systems , 2010, Current Opinion in Neurobiology.

[17]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[18]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[19]  Gustavo Deco,et al.  Stochastic dynamics as a principle of brain function , 2009, Progress in Neurobiology.

[20]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Frank Moss,et al.  Use of behavioural stochastic resonance by paddle fish for feeding , 1999, Nature.

[23]  K. Boahen Neuromorphic Microchips. (Cover story) , 2005 .

[24]  Shantanu Chakrabartty,et al.  Far-Field Acoustic Source Localization and Bearing Estimation Using $\Sigma\Delta$ Learners , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[26]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[27]  Tomaso A. Poggio,et al.  Regularization Theory and Neural Networks Architectures , 1995, Neural Computation.

[28]  Richard F. Lyon,et al.  An analog electronic cochlea , 1988, IEEE Trans. Acoust. Speech Signal Process..

[29]  Marcel Dijkstra,et al.  Biomimetic micromechanical adaptive flow-sensor arrays , 2007, SPIE Microtechnologies.

[30]  A. A. Verveen,et al.  Fluctuations of Resting Neural Membrane Potential , 1966, Science.

[31]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[32]  M. Tovée,et al.  Information encoding in short firing rate epochs by single neurons in the primate temporal visual cortex , 1995 .

[33]  Gregoire Nicolis,et al.  Stochastic resonance , 2007, Scholarpedia.

[34]  Shantanu Chakrabartty,et al.  Large Margin Multi-channel Analog-to-Digital Conversion with Applications to Neural Prosthesis , 2006, NIPS.

[35]  R N Miles,et al.  The Development of a Biologically-Inspired Directional Microphone for Hearing Aids , 2006, Audiology and Neurotology.

[36]  Andrew C. Mason,et al.  Hyperacute directional hearing in a microscale auditory system , 2001, Nature.

[37]  Carson C. Chow,et al.  Noise shaping in populations of coupled model neurons. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[39]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[40]  Martin C Göpfert,et al.  Novel schemes for hearing and orientation in insects , 2002, Current Opinion in Neurobiology.