Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits

As advances in integrated circuit (IC) fabrication technology reduce feature sizes to dimensions on the order of nanometers, IC designers are facing many of the problems that evolution has had to overcome in order to perform meaningful and accurate computations in biological neural circuits. In this paper, we explore the current state of IC technology including the many new and exciting opportunities “beyond CMOS.” We review the role of noise in both biological and engineered systems and discuss how “stochastic facilitation” can be used to perform useful and precise computation. We explore nondeterministic methodologies for computation in hardware and introduce the concept of stochastic electronics (SE); a new way to design circuits and increase performance in highly noisy and mismatched fabrication environments. This approach is illustrated with several circuit examples whose results demonstrate its exciting potential.

[1]  Yoshifumi Nishio,et al.  Performance of chaotic switching noise injected to Hopfield NN for quadratic assignment problem , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[2]  Kevan A. C. Martin,et al.  Topology and dynamics of the canonical circuit of cat V1 , 2009, Neural Networks.

[3]  Jonathan Tapson,et al.  A neuromorphic cross-correlation chip , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[4]  Ralph Etienne-Cummings,et al.  A First-Order Nonhomogeneous Markov Model for the Response of Spiking Neurons Stimulated by Small Phase-Continuous Signals , 2008, Neural Computation.

[5]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[6]  Richard F. Lyon,et al.  Improved implementation of the silicon cochlea , 1992 .

[7]  Richard E. Brown,et al.  Report to Congress on Server and Data Center Energy Efficiency: Public Law 109-431 , 2008 .

[8]  Robert H. Dennard,et al.  Practical Strategies for Power-Efficient Computing Technologies , 2010, Proceedings of the IEEE.

[9]  R. Waser,et al.  Memristors: Devices, Models, and Applications , 2012 .

[10]  J. White,et al.  Channel noise in neurons , 2000, Trends in Neurosciences.

[11]  P. Bruce,et al.  Nanostructured materials for advanced energy conversion and storage devices , 2005, Nature materials.

[12]  Mark D. McDonnell,et al.  Metabolic cost of neuronal information in an empirical stimulus-response model , 2013, Biological Cybernetics.

[13]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[14]  Gert Cauwenberghs,et al.  Dynamically Reconfigurable Silicon Array of Spiking Neurons With Conductance-Based Synapses , 2007, IEEE Transactions on Neural Networks.

[15]  Carson C. Chow,et al.  Noise shaping in populations of coupled model neurons. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[16]  C. Carr,et al.  Timing is everything: Organization of timing circuits in auditory and electrical sensory systems , 2004, The Journal of comparative neurology.

[17]  Susan Stepney,et al.  Engineering emergence , 2006, 11th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS'06).

[18]  J. Tapson,et al.  A Scalable Architecture for Event-Based Cross-Correlation , 2007, 2007 IEEE Biomedical Circuits and Systems Conference.

[19]  Enrico Temporiti,et al.  A 3.5 GHz Wideband ADPLL With Fractional Spur Suppression Through TDC Dithering and Feedforward Compensation , 2010, IEEE Journal of Solid-State Circuits.

[20]  Rahul Sarpeshkar,et al.  Ultra Low Power Bioelectronics: Epilogue , 2010 .

[21]  Yong Liu,et al.  A 45nm CMOS neuromorphic chip with a scalable architecture for learning in networks of spiking neurons , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[22]  Gregory Cohen,et al.  Synthesis of neural networks for spatio-temporal spike pattern recognition and processing , 2013, Front. Neurosci..

[23]  P. Avouris,et al.  Carbon-based electronics. , 2007, Nature nanotechnology.

[24]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[25]  T. Sejnowski,et al.  Origin of intrinsic irregular firing in cortical interneurons , 2013, Proceedings of the National Academy of Sciences.

[26]  A. van Schaik,et al.  An Analog VLSI Model of Periodicity Extraction in the Human Auditory System , 1999 .

[27]  T. Delbruck,et al.  A 64x64 aer logarithmic temporal derivative silicon retina , 2005, Research in Microelectronics and Electronics, 2005 PhD.

[28]  DH Edwards,et al.  Mutual inhibition among neural command systems as a possible mechanism for behavioral choice in crayfish , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Barry L. Shoop,et al.  Analog-to-Digital Conversion Using Single-Layer Integrate-and-Fire Networks with Inhibitory Connections , 2004, EURASIP J. Adv. Signal Process..

[30]  D. H. K. Hoe,et al.  The use of error correcting codes for nanoelectronic systems: Overview and future prospects , 2013, 45th Southeastern Symposium on System Theory.

[31]  Franz Kreupl,et al.  Electronics: The carbon-nanotube computer has arrived , 2013, Nature.

[32]  Wulfram Gerstner,et al.  Statistics of subthreshold neuronal voltage fluctuations due to conductance-based synaptic shot noise. , 2006, Chaos.

[33]  Gert Cauwenberghs,et al.  Biophysical Neural Spiking, Bursting, and Excitability Dynamics in Reconfigurable Analog VLSI , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[34]  Misha A. Mahowald,et al.  Silicon retina with adaptive photoreceptors , 1991, Defense, Security, and Sensing.

[35]  Guoqi Zhang,et al.  More than Moore: Creating High Value Micro/Nanoelectronics Systems , 2009 .

[36]  R. Sarpeshkar,et al.  A Bio-Inspired Active Radio-Frequency Silicon Cochlea , 2009, IEEE Journal of Solid-State Circuits.

[37]  André van Schaik,et al.  An asynchronous parallel neuromorphic ADC architecture , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[38]  R. Keyes.  Physical limits of silicon transistors and circuits , 2005 .

[39]  Olaf Sporns,et al.  Neurobiologically Realistic Determinants of Self-Organized Criticality in Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[40]  Mahmut T. Kandemir,et al.  Leakage Current: Moore's Law Meets Static Power , 2003, Computer.

[41]  Chris Winstead,et al.  A Probabilistic LDPC-Coded Fault Compensation Technique for Reliable Nanoscale Computing , 2009, IEEE Transactions on Circuits and Systems II: Express Briefs.

[42]  Jacek Izydorczyk,et al.  Microprocessor Scaling: What Limits Will Hold? , 2010, Computer.

[43]  B. Scrosati,et al.  Lithium batteries: Status, prospects and future , 2010 .

[44]  I. Galton,et al.  A digitally enhanced 1.8-V 15-bit 40-MSample/s CMOS pipelined ADC , 2004, IEEE Journal of Solid-State Circuits.

[45]  E. Vianello,et al.  Bio-Inspired Stochastic Computing Using Binary CBRAM Synapses , 2013, IEEE Transactions on Electron Devices.

[46]  Terrence C. Stewart,et al.  Nengo and the Neural Engineering Framework: Connecting Cognitive Theory to Neuroscience , 2011, CogSci.

[47]  E. Vittoz,et al.  Present and Future Industrial Applications of Bio-Inspired VLSI Systems , 1999, Proceedings of the Seventh International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems.

[48]  O. Sporns,et al.  The economy of brain network organization , 2012, Nature Reviews Neuroscience.

[49]  Randolph Kirchain,et al.  A roadmap for nanophotonics , 2007 .

[50]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[51]  Muhammad Ashraful Alam,et al.  Reliability- and Process-variation aware design of integrated circuits — A broader perspective , 2008, 2011 International Reliability Physics Symposium.

[52]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[53]  Ralph Etienne-Cummings,et al.  A CMOS switched capacitor implementation of the Mihalas-Niebur neuron , 2009, 2009 IEEE Biomedical Circuits and Systems Conference.

[54]  Jiantao Zhou,et al.  Stochastic Memristive Devices for Computing and Neuromorphic Applications , 2013, Nanoscale.

[55]  W. Gerstner,et al.  Temporal whitening by power-law adaptation in neocortical neurons , 2013, Nature Neuroscience.

[56]  Christoph M. Kirsch,et al.  Incorrect systems: It's not the problem, It's the solution , 2012, DAC Design Automation Conference 2012.

[57]  D Nozaki,et al.  Mechanism of stochastic resonance enhancement in neuronal models driven by 1/f noise. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[58]  P. Hänggi,et al.  Stochastic Resonance: A remarkable idea that changed our perception of noise , 2009 .

[59]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[60]  Ralph Etienne-Cummings,et al.  Implementing a neuromorphic cross-correlation engine with silicon neurons , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[61]  Mohammed Ismail,et al.  Analog VLSI Implementation of Neural Systems , 2011, The Kluwer International Series in Engineering and Computer Science.

[62]  C. Auth,et al.  A 22nm high performance and low-power CMOS technology featuring fully-depleted tri-gate transistors, self-aligned contacts and high density MIM capacitors , 2012, 2012 Symposium on VLSI Technology (VLSIT).

[63]  M. Y. Simmons,et al.  A single atom transistor , 2012, 2012 IEEE Silicon Nanoelectronics Workshop (SNW).

[64]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[65]  E. Culurciello,et al.  A biomorphic digital image sensor , 2003, IEEE J. Solid State Circuits.

[66]  Krishna V. Palem,et al.  Probabilistic system-on-a-chip architectures , 2007, TODE.

[67]  Tobi Delbrück,et al.  Event-based 64-channel binaural silicon cochlea with Q enhancement mechanisms , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[68]  Wilfried Haensch,et al.  Near-threshold operation for power-efficient computing? It depends… , 2012, DAC Design Automation Conference 2012.

[69]  Andrew S. Dzurak,et al.  A single-atom electron spin qubit in silicon , 2012, Nature.

[70]  Wulfram Gerstner,et al.  Synaptic Shot Noise and Conductance Fluctuations Affect the Membrane Voltage with Equal Significance , 2005, Neural Computation.

[71]  John Sartori,et al.  Stochastic computing: Embracing errors in architecture and design of processors and applications , 2011, 2011 Proceedings of the 14th International Conference on Compilers, Architectures and Synthesis for Embedded Systems (CASES).

[72]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[73]  Terrence J Sejnowski,et al.  Communication in Neuronal Networks , 2003, Science.

[74]  Lingamneni Avinash,et al.  Ten Years of Building Broken Chips: The Physics and Engineering of Inexact Computing , 2013, TECS.

[75]  R. Montoye,et al.  Beyond Moore's Law: the interconnect era , 2004, Computing in Science & Engineering.

[76]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[77]  Ralph Etienne-Cummings,et al.  A two-neuron cross-correlation circuit with a wide and continuous range of time delay , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[78]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[79]  Paolo Lugli,et al.  Science and Engineering Beyond Moore's Law , 2012, Proceedings of the IEEE.

[80]  Simon B. Laughlin,et al.  Energy-Efficient Coding with Discrete Stochastic Events , 2002, Neural Computation.

[81]  K. Schuegraf,et al.  Transistor wars , 2011, IEEE Spectrum.

[82]  Stefan Mihalas,et al.  Self-organized criticality occurs in non-conservative neuronal networks during Up states , 2010, Nature physics.

[83]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[84]  A. Ijspeert,et al.  Frequency Analysis with coupled nonlinear Oscillators , 2008 .

[85]  Hui Li,et al.  A Stochastic-Based FPGA Controller for an Induction Motor Drive With Integrated Neural Network Algorithms , 2008, IEEE Transactions on Industrial Electronics.

[86]  Andreas G. Andreou,et al.  A Contrast Sensitive Silicon Retina with Reciprocal Synapses , 1991, NIPS.

[87]  Moshe Abeles,et al.  Time Is Precious , 2004, Science.

[88]  A. Steger,et al.  Reliable Neuronal Systems: The Importance of Heterogeneity , 2013, PloS one.

[89]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[90]  Jie Han,et al.  Approximate computing: An emerging paradigm for energy-efficient design , 2013, 2013 18th IEEE European Test Symposium (ETS).

[91]  Derek Abbott,et al.  What Is Stochastic Resonance? Definitions, Misconceptions, Debates, and Its Relevance to Biology , 2009, PLoS Comput. Biol..

[92]  Kurths,et al.  Phase synchronization of chaotic oscillators. , 1996, Physical review letters.

[93]  Sucbei Moon,et al.  Reference spectrum extraction and fixed-pattern noise removal in optical coherence tomography , 2010, Optics express.

[94]  Regina Frei,et al.  The future of complexity engineering , 2012 .

[95]  Shubu Mukherjee,et al.  Architecture Design for Soft Errors , 2008 .

[96]  W. Arden,et al.  More Than Moore White Paper , 2021, 2021 IEEE International Roadmap for Devices and Systems Outbriefs.

[97]  Thomas J. Naughton,et al.  Photonic neural networks , 2012, Nature Physics.

[98]  A. Willner,et al.  Terabit free-space data transmission employing orbital angular momentum multiplexing , 2012, Nature Photonics.

[99]  Aurel A. Lazar,et al.  Time Encoding of Bandlimited Signals, an Overview ∗ , 2005 .

[100]  Behzad Razavi,et al.  A New DAC Mismatch Shaping Technique for Sigma–Delta Modulators , 2010, IEEE Transactions on Circuits and Systems II: Express Briefs.

[101]  Craig T. Jin,et al.  An Active 2-D Silicon Cochlea , 2008, IEEE Transactions on Biomedical Circuits and Systems.

[102]  Yong Ping Xu,et al.  Multibit Delta-Sigma Modulator With Noise-Shaping Dynamic Element Matching , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[103]  Benjamin Lindner,et al.  How Noisy Adaptation of Neurons Shapes Interspike Interval Histograms and Correlations , 2010, PLoS Comput. Biol..

[104]  Douglas L. Jones,et al.  Stochastic computation , 2010, Design Automation Conference.

[105]  Ralph K. Cavin,et al.  The quest for the next information processing technology , 2008 .

[106]  Robert B. Staszewski,et al.  Spur-Free Multirate All-Digital PLL for Mobile Phones in 65 nm CMOS , 2011, IEEE Journal of Solid-State Circuits.

[107]  Amine Bermak,et al.  A 96 /spl times/ 64 intelligent digital pixel array with extended binary stochastic arithmetic , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[108]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[109]  Damien Querlioz,et al.  Stochastic resonance in an analog current-mode neuromorphic circuit , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[110]  Andrew S. Cassidy,et al.  Design of silicon brains in the nano-CMOS era: Spiking neurons, learning synapses and neural architecture optimization , 2013, Neural Networks.

[111]  M. Armand,et al.  Building better batteries , 2008, Nature.

[112]  O. Prospero-Garcia,et al.  Reliability of Spike Timing in Neocortical Neurons , 1995 .

[113]  Christof Koch,et al.  Detecting and Estimating Signals in Noisy Cable Structures, I: Neuronal Noise Sources , 1999, Neural Computation.

[114]  Andrew Marshall.  Mismatch and Noise in Modern IC Processes , 2009, Mismatch and Noise in Modern IC Processes.

[115]  Kurt Wiesenfeld,et al.  Mechanoelectrical transduction assisted by Brownian motion: a role for noise in the auditory system , 1998, Nature Neuroscience.

[116]  Kaushik Roy,et al.  Low-power design techniques for scaled technologies , 2006, Integr..

[117]  James A. Hutchby,et al.  Limits to binary logic switch scaling - a gedanken model , 2003, Proc. IEEE.

[118]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[119]  David Blaauw,et al.  Near-Threshold Computing: Reclaiming Moore's Law Through Energy Efficient Integrated Circuits , 2010, Proceedings of the IEEE.

[120]  Frank Moss,et al.  Noise in human muscle spindles , 1996, Nature.

[121]  André Longtin,et al.  Noise shaping by interval correlations increases information transfer. , 2004, Physical review letters.

[122]  Shantanu Chakrabartty,et al.  Noise-Shaping Gradient Descent-Based Online Adaptation Algorithms for Digital Calibration of Analog Circuits , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[123]  R. Degraeve,et al.  Trends and perspectives for electrical characterization and reliability assessment in advanced CMOS technologies , 2010, 2010 Proceedings of the European Solid State Device Research Conference.

[124]  André van Schaik,et al.  The self-tuned regenerative electromechanical arametric amplifier: A model for Active amplification in the cochlea , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[125]  E. Evans,et al.  Enhancement of vowel coding for cochlear implants by addition of noise , 1996, Nature Medicine.

[126]  Igor Neri,et al.  Nanowatt logic stochastic resonance in branched resonant tunneling diodes , 2011 .

[127]  S. D. Pable,et al.  Ultra-low-power signaling challenges for subthreshold global interconnects , 2012, Integr..

[128]  Kelvin E. Jones,et al.  Neuronal variability: noise or part of the signal? , 2005, Nature Reviews Neuroscience.

[129]  Shaista Hussain,et al.  Computation using mismatch: Neuromorphic extreme learning machines , 2013, 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[130]  Laszlo B. Kish.  Noise-based logic: Binary, multi-valued, or fuzzy, with optional superposition of logic states , 2009 .

[131]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[132]  B. Neumcke,et al.  1/f noise in membranes , 1978, Biophysics of structure and mechanism.

[133]  S. Sarma,et al.  Electronic transport in two-dimensional graphene , 2010, 1003.4731.

[134]  Henk Spekreijse,et al.  Dynamic Characteristics of Retinal Ganglion Cell Responses in Goldfish , 1972, The Journal of general physiology.

[135]  Omid Kavehei,et al.  Emergence of competitive control in a memristor-based neuromorphic circuit , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[136]  Gregory Cohen,et al.  An FPGA Implementation of a Polychronous Spiking Neural Network with Delay Adaptation , 2013, Front. Neurosci..

[137]  Kwabena Boahen,et al.  Neurogrid: emulating a million neurons in the cortex. , 2006, EMBC 2006.

[138]  William B. Langdon,et al.  Graphics processing units and genetic programming: an overview , 2011, Soft Comput..

[139]  D. B. Strukov,et al.  Programmable CMOS/Memristor Threshold Logic , 2013, IEEE Transactions on Nanotechnology.

[140]  J. Borst.  The low synaptic release probability in vivo , 2010, Trends in Neurosciences.

[141]  Terrence J Sejnowski,et al.  Learning optimal strategies in complex environments , 2010, Proceedings of the National Academy of Sciences.

[142]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[143]  Brian R. Gaines,et al.  Stochastic computing , 1967, AFIPS '67 (Spring).

[144]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[145]  Sung-Mo Kang,et al.  Memristors: Devices, Models, and Applications [Scanning the Issue] , 2012, Proc. IEEE.

[146]  K. Boahen.  Neuromorphic Microchips. , 2005, Scientific American.

[147]  Samuel H. Fuller,et al.  Computing Performance: Game Over or Next Level? , 2011, Computer.

[148]  Martin Stemmler,et al.  Power Consumption During Neuronal Computation , 2014, Proceedings of the IEEE.

[149]  M.Z. Straayer,et al.  A Multi-Path Gated Ring Oscillator TDC With First-Order Noise Shaping , 2009, IEEE Journal of Solid-State Circuits.

[150]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[151]  Chenming Hu,et al.  3D FinFET and other sub-22nm transistors , 2012, 2012 19th IEEE International Symposium on the Physical and Failure Analysis of Integrated Circuits.

[152]  S. Laughlin,et al.  Energy limitation as a selective pressure on the evolution of sensory systems , 2008, Journal of Experimental Biology.

[153]  Craig Jin,et al.  An analysis of matching in the Tau cell log-domain filter , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[154]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[155]  John P. Hayes,et al.  Survey of Stochastic Computing , 2013, TECS.

[156]  Jan Wessnitzer,et al.  Resonant neurons and bushcricket behaviour , 2007, Journal of Comparative Physiology A.

[157]  Christian Joachim,et al.  Architecture and Design of Molecule Logic Gates and Atom Circuits: Proceedings of the 2nd AtMol European Workshop , 2013 .

[158]  Mark D. McDonnell,et al.  Is electrical noise useful? [Point of View] , 2011, Proceedings of the IEEE.

[159]  C. Wagner,et al.  EUV lithography: Lithography gets extreme , 2010 .

[160]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[161]  P. Lennie.  The Cost of Cortical Computation , 2003, Current Biology.

[162]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[163]  SeongHwan Cho,et al.  A 2.4 GHz Fractional-N Frequency Synthesizer With High-OSR ΔΣ Modulator and Nested PLL , 2012, IEEE Journal of Solid-State Circuits.

[164]  James D. Meindl,et al.  Carbon nanotube interconnects , 2007, ISPD '07.

[165]  C. Stevens,et al.  Synaptic noise and other sources of randomness in motoneuron interspike intervals. , 1968, Journal of neurophysiology.

[166]  G. Ermentrout,et al.  Reliability, synchrony and noise , 2008, Trends in Neurosciences.

[167]  Giacomo Indiveri,et al.  Exploiting device mismatch in neuromorphic VLSI systems to implement axonal delays , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[168]  Ralph Etienne-Cummings,et al.  A Simple Neural Cross-Correlation Engine , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[169]  Wolfgang Maass,et al.  Noise as a Resource for Computation and Learning in Networks of Spiking Neurons , 2014, Proceedings of the IEEE.