Emergent Inference of Hidden Markov Models in Spiking Neural Networks Through Winner-Take-All

Hidden Markov models (HMMs) underpin the solution to many problems in computational neuroscience. However, it is still unclear how to implement inference of HMMs with a network of neurons in the brain. The existing methods suffer from the problem of being nonspiking and inaccurate. Here, we build a precise equivalence between the inference equation of HMMs with time-invariant hidden variables and the dynamics of spiking winner-take-all (WTA) neural networks. We show that the membrane potential of each spiking neuron in the WTA circuit encodes the logarithm of the posterior probability of the hidden variable in each state, and the firing rate of each neuron is proportional to the posterior probability of the HMMs. We prove that the time course of the neural firing rate can implement posterior inference of HMMs. Theoretical analysis and experimental results show that the proposed WTA circuit can get accurate inference results of HMMs.

[1]  Mauro Ursino,et al.  Neurocomputational approaches to modelling multisensory integration in the brain: A review , 2014, Neural Networks.

[2]  Ari Rosenberg,et al.  Models and processes of multisensory cue combination , 2014, Current Opinion in Neurobiology.

[3]  Jean-Pascal Pfister,et al.  Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning , 2005, Neural Computation.

[4]  Henning Sprekeler,et al.  Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity , 2010, The Journal of Neuroscience.

[5]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[6]  D. Meschede,et al.  Hidden Markov model of atomic quantum jump dynamics in an optically probed cavity , 2014 .

[7]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[8]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.

[9]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[10]  Mahmood R. Azimi-Sadjadi,et al.  Multi-aspect target discrimination using hidden Markov models and neural networks , 2005, IEEE Transactions on Neural Networks.

[11]  Anthony S. Maida,et al.  Training a Hidden Markov Model with a Bayesian Spiking Neural Network , 2016, Journal of Signal Processing Systems.

[12]  Rasmus Nielsen,et al.  A hidden Markov model approach for simultaneously estimating local ancestry and admixture time using next generation sequence data in samples of arbitrary ploidy , 2016 .

[13]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[14]  Yonina C. Eldar,et al.  Bayesian Filtering in Spiking Neural Networks: Noise, Adaptation, and Multisensory Integration , 2009, Neural Computation.

[15]  Qionghai Dai,et al.  Sampling-based causal inference in cue combination and its neural implementation , 2016, Neurocomputing.

[16]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[17]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[18]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[19]  Stephen Grossberg,et al.  Stereopsis and 3D surface perception by spiking neurons in laminar cortical circuits: A method for converting neural rate models into spiking models , 2012, Neural Networks.

[20]  Subhrajit Roy,et al.  An Online Unsupervised Structural Plasticity Algorithm for Spiking Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[22]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[23]  Shih-Chii Liu,et al.  Computation with Spikes in a Winner-Take-All Network , 2009, Neural Computation.

[24]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[25]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[26]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[27]  Ammar Belatreche,et al.  Adaptive Hidden Markov Model With Anomaly States for Price Manipulation Detection , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[29]  Alexandre Pouget,et al.  Confidence and certainty: distinct probabilistic quantities for different goals , 2016, Nature Neuroscience.

[30]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[31]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[32]  Fernando Pérez-Cruz,et al.  Infinite Factorial Unbounded-State Hidden Markov Model , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[34]  Zhaofei Yu,et al.  Unification of MAP Estimation and Marginal Inference in Recurrent Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[35]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[36]  Manolis Kellis,et al.  Multi-scale chromatin state annotation using a hierarchical hidden Markov model , 2017, Nature Communications.

[37]  Chen Lu,et al.  A Normalized Statistical Metric Space for Hidden Markov Models , 2013, IEEE Transactions on Cybernetics.

[38]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[39]  Haizhou Li,et al.  A Spiking Neural Network System for Robust Sequence Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[41]  Alexandre Pouget,et al.  Exact Inferences in a Neural Implementation of a Hidden Markov Model , 2007, Neural Computation.

[42]  Jan Drugowitsch,et al.  Causal Inference and Explaining Away in a Spiking Network , 2015, Scientific Reports.

[43]  Sophie Denève,et al.  Bayesian Inference with Spiking Neurons , 2004, Encyclopedia of Computational Neuroscience.

[44]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[45]  Peter Dayan,et al.  Doubly Distributional Population Codes: Simultaneous Representation of Uncertainty and Multiplicity , 2003, Neural Computation.

[46]  Fu-Rong Jean,et al.  Adaptation of Hidden Markov Models for Recognizing Speech of Reduced Frame Rate , 2013, IEEE Transactions on Cybernetics.

[47]  Chandramouli Chandrasekaran,et al.  Computational principles and models of multisensory integration , 2017, Current Opinion in Neurobiology.

[48]  Eugenius Kaszkurewicz,et al.  A winner-take-all circuit using neural networks as building blocks , 2005, Neurocomputing.

[49]  Rajesh P. N. Rao.  Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.