Noise as a Resource for Computation and Learning in Networks of Spiking Neurons

We are used to viewing noise as a nuisance in computing systems. This is a pity, since noise will be abundantly available in energy-efficient future nanoscale devices and circuits. I propose here to learn from the way the brain deals with noise, and apparently even benefits from it. Recent theoretical results have provided insight into how this can be achieved: how noise enables networks of spiking neurons to carry out probabilistic inference through sampling and also enables creative problem solving. In addition, noise supports the self-organization of networks of spiking neurons, and learning from rewards. I will sketch here the main ideas and some consequences of these results. I will also describe why these results are paving the way for a qualitative jump in the computational capability and learning performance of neuromorphic networks of spiking neurons with noise, and for other future computing systems that are able to treat noise as a resource.

[1]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[2]  Marc Toussaint,et al.  A Bayesian View on Motor Control and Planning , 2010, From Motor Learning to Interaction Learning in Robots.

[3]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[4]  D. Snodderly,et al.  Response Variability of Neurons in Primary Visual Cortex (V1) of Alert Monkeys , 1997, The Journal of Neuroscience.

[5]  Terrence J. Sejnowski,et al.  Engineering intelligent electronic systems based on computational neuroscience [scanning the issue] , 2014, Proc. IEEE.

[6]  Wolfgang Maass,et al.  Cerebral Cortex Advance Access published February 15, 2006 A Statistical Analysis of Information- Processing Properties of Lamina-Specific , 2022 .

[7]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[8]  Rajesh P. N. Rao.  Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[9]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[10]  Stefan Habenschuss,et al.  Stochastic Computations in Cortical Microcircuit Models , 2013, PLoS Comput. Biol..

[11]  Christian K. Machens,et al.  Predictive Coding of Dynamical Variables in Balanced Spiking Networks , 2013, PLoS Comput. Biol..

[12]  John P. Hayes,et al.  Survey of Stochastic Computing , 2013, TECS.

[13]  Geoffrey E. Hinton,et al.  An Efficient Learning Procedure for Deep Boltzmann Machines , 2012, Neural Computation.

[14]  M. Raichle.  Two views of brain function , 2010, Trends in Cognitive Sciences.

[15]  Robert A. Legenstein,et al.  A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback , 2008, PLoS Comput. Biol..

[16]  J. Hounsgaard,et al.  Voltage fluctuations in neurons: signal or noise? , 2011, Physiological reviews.

[17]  S. Denéve,et al.  Neural processing as causal inference , 2011, Current Opinion in Neurobiology.

[18]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[19]  Terence D Sanger,et al.  Neural population codes , 2003, Current Opinion in Neurobiology.

[20]  Yohsuke R. Miyamoto,et al.  Temporal structure of motor variability is dynamically regulated and predicts motor learning ability , 2014, Nature Neuroscience.

[21]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[22]  R. N. Spreng,et al.  The Future of Memory: Remembering, Imagining, and the Brain , 2012, Neuron.

[23]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[24]  Ehl Emile Aarts,et al.  Simulated annealing and Boltzmann machines , 2003 .

[25]  P. Clarke,et al.  The limits of brain determinacy , 2012, Proceedings of the Royal Society B: Biological Sciences.

[26]  D. Ferster,et al.  The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. , 2000, Science.

[27]  D. McVea,et al.  Spontaneous cortical activity alternates between motifs defined by regional axonal projections , 2013, Nature Neuroscience.

[28]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[29]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[30]  Johannes Schemmel,et al.  Stochastic inference with deterministic spiking neurons , 2013, ArXiv.

[31]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[32]  Stefan Habenschuss,et al.  Emergence of Optimal Decoding of Population Codes Through STDP , 2013, Neural Computation.

[33]  József Fiser,et al.  Probabilistic computation: A possible functional role for spontaneous activity in the cortex , 2011 .

[34]  Stefan Habenschuss,et al.  Distributed Bayesian Computation and Self-Organized Learning in Sheets of Spiking Neurons with Local Lateral Inhibition , 2015, PloS one.

[35]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[36]  J. Seamans,et al.  Default activity patterns at the neocortical microcircuit level , 2012, Front. Integr. Neurosci..

[37]  J. Bowers,et al.  Bayesian just-so stories in psychology and neuroscience. , 2012, Psychological bulletin.

[38]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[39]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[40]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[41]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[42]  Wolfgang Maass,et al.  Belief Propagation in Networks of Spiking Neurons , 2009, Neural Computation.

[43]  Johannes Schemmel,et al.  Six Networks on a Universal Neuromorphic Computing Substrate , 2012, Front. Neurosci..

[44]  Joshua B. Tenenbaum,et al.  Multistability and Perceptual Inference , 2012, Neural Computation.

[45]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[46]  H. Pashler,et al.  Measuring the Crowd Within , 2008, Psychological science.

[47]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.

[48]  M. Botvinick,et al.  Planning as inference , 2012, Trends in Cognitive Sciences.

[49]  D. Norris,et al.  How the Bayesians got their beliefs (and what those beliefs actually are): comment on Bowers and Davis (2012). , 2012, Psychological bulletin.

[50]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[51]  N. Chater,et al.  The probabilistic approach to human reasoning , 2001, Trends in Cognitive Sciences.

[52]  L. Abbott,et al.  Two layers of neural variability , 2012, Nature Neuroscience.

[53]  Wolfgang Maass,et al.  Lower Bounds for the Computational Power of Networks of Spiking Neurons , 1996, Neural Computation.

[54]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[55]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[56]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[57]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[58]  David Kappel,et al.  NEVESIM: event-driven neural simulation framework with a Python interface , 2014, Front. Neuroinform..

[59]  Wolfgang Maass,et al.  Emergence of Dynamic Memory Traces in Cortical Microcircuit Models through STDP , 2013, The Journal of Neuroscience.

[60]  Rajesh P. N. Rao,et al.  Predictive Coding , 2019, A Blueprint for the Hard Problem of Consciousness.

[61]  Cristina Savin,et al.  How (not) to assess the importance of correlations for the matching of spontaneous and evoked activity , 2013 .

[62]  L. Pinneo.  On noise in the nervous system. , 1966, Psychological review.

[63]  G. Buzsáki,et al.  Temporal Encoding of Place Sequences by Hippocampal Cell Assemblies , 2006, Neuron.

[64]  John J. Hopfield,et al.  Searching for Memories, Sudoku, Implicit Check Bits, and the Iterative Use of Not-Always-Correct Rapid Neural Computation , 2006, Neural Computation.

[65]  André van Schaik,et al.  Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits , 2014, Proceedings of the IEEE.

[66]  Peter Elias,et al.  Predictive coding-I , 1955, IRE Trans. Inf. Theory.

[67]  G. I. Kustova,et al.  From the author , 2019, Automatic Documentation and Mathematical Linguistics.

[68]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[69]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[70]  Moritz Helias,et al.  Decorrelation of Neural-Network Activity by Inhibitory Feedback , 2012, PLoS Comput. Biol..

[71]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[72]  W. Singer.  Cortical dynamics revisited , 2013, Trends in Cognitive Sciences.

[73]  J. Borst.  The low synaptic release probability in vivo , 2010, Trends in Neurosciences.

[74]  Eli Upfal,et al.  Probability and Computing: Randomized Algorithms and Probabilistic Analysis , 2005 .

[75]  Geoffrey E. Hinton,et al.  OPTIMAL PERCEPTUAL INFERENCE , 1983 .

[76]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[77]  Reza Shadmehr,et al.  Motor variability is not noise, but grist for the learning mill , 2014, Nature Neuroscience.

[78]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[79]  M. Carandini,et al.  Population Rate Dynamics and Multineuron Firing Patterns in Sensory Cortex , 2012, The Journal of Neuroscience.

[80]  Wolfgang Maass,et al.  Emergence of complex computational structures from chaotic neural networks through reward-modulated Hebbian learning. , 2014, Cerebral cortex.

[81]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[82]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.