The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons. One particular requirement of this approach is that the neural response function closely follows a logistic curve.
Analytical approaches to calculating neural response functions have been the subject of many theoretical studies. In order to make the problem tractable, particular assumptions regarding the neural or synaptic parameters are usually made. However, biologically significant activity regimes exist which are not covered by these approaches: Under strong synaptic bombardment, as is often the case in cortex, the neuron is shifted into a high-conductance state (HCS) characterized by a small membrane time constant. In this regime, synaptic time constants and refractory periods dominate membrane dynamics.
The core idea of our approach is to separately consider two different "modes" of spiking dynamics: burst spiking and transient quiescence, in which the neuron does not spike for longer periods. We treat the former by propagating the PDF of the effective membrane potential from spike to spike within a burst, while using a diffusion approximation for the latter. We find that our prediction of the neural response function closely matches simulation data. Moreover, in the HCS scenario, we show that the neural response function becomes symmetric and can be well approximated by a logistic function, thereby providing the correct dynamics in order to perform neural sampling. We hereby provide not only a normative framework for Bayesian inference in cortex, but also powerful applications of low-power, accelerated neuromorphic systems to relevant machine learning tasks.
[1]
P. Berkes,et al.
Statistically Optimal Perception and Learning: from Behavior to Neural Representations
,
2022
.
[2]
Karl J. Friston,et al.
Action understanding and active inference
,
2011,
Biological Cybernetics.
[3]
N. B,et al.
Firing Frequency of Leaky Integrate-and-fire Neurons with Synaptic Current Dynamics
,
1998
.
[4]
Johannes Schemmel,et al.
Stochastic inference with deterministic spiking neurons
,
2013,
ArXiv.
[5]
Wolfgang Maass,et al.
Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons
,
2011,
PLoS Comput. Biol..
[6]
Johannes Schemmel,et al.
Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons
,
2014,
Front. Comput. Neurosci..
[7]
Shunsuke Sato,et al.
First-passage-time density and moments of the Ornstein-Uhlenbeck process
,
1988
.
[8]
N. Brunel,et al.
Firing frequency of leaky intergrate-and-fire neurons with synaptic current dynamics.
,
1998,
Journal of theoretical biology.
[9]
N. Parga,et al.
Role of synaptic filtering on the firing response of simple model neurons.
,
2004,
Physical review letters.
[10]
Konrad Paul Kording,et al.
Bayesian integration in sensorimotor learning
,
2004,
Nature.
[11]
L. Ricciardi,et al.
The Ornstein-Uhlenbeck process as a model for neuronal activity
,
1979,
Biological Cybernetics.
[12]
Timothy D. Griffiths,et al.
This Work Is Licensed under a Creative Commons Attribution 4.0 International License Auditory Working Memory for Objects vs. Features
,
2022
.
[13]
Wolfgang Maass,et al.
Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons
,
2011,
PLoS Comput. Biol..