Flexible statistical inference for mechanistic models of neural dynamics

Mechanistic models of single-neuron dynamics have been extensively studied in computational neuroscience. However, identifying which models can quantitatively reproduce empirically measured data has been challenging. We propose to overcome this limitation by using likelihood-free inference approaches (also known as Approximate Bayesian Computation, ABC) to perform full Bayesian inference on single-neuron models. Our approach builds on recent advances in ABC by learning a neural network which maps features of the observed data to the posterior distribution over parameters. We learn a Bayesian mixture-density network approximating the posterior over multiple rounds of adaptively chosen simulations. Furthermore, we propose an efficient approach for handling missing features and parameter settings for which the simulator fails, as well as a strategy for automatically learning relevant features using recurrent neural networks. On synthetic data, our approach efficiently estimates posterior distributions and recovers ground-truth parameters. On in-vitro recordings of membrane voltages, we recover multivariate posteriors over biophysical parameters, which yield model-predicted voltage traces that accurately match empirical data. Our approach will enable neuroscientists to perform Bayesian inference on complex neuron models without having to design model-specific algorithms, closing the gap between mechanistic and statistical approaches to single-neuron modelling.

[1]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .

[2]  David T. Frazier,et al.  Bayesian Synthetic Likelihood , 2017, 2305.05120.

[3]  Bai Jiang,et al.  Learning Summary Statistic for Approximate Bayesian Computation via Deep Neural Network , 2015, 1510.02175.

[4]  Liam Paninski,et al.  Smoothing of, and Parameter Estimation from, Noisy Biophysical Recordings , 2009, PLoS Comput. Biol..

[5]  Brandon M. Turner,et al.  A generalized, likelihood-free method for posterior estimation , 2014, Psychonomic bulletin & review.

[6]  James G. King,et al.  Reconstruction and Simulation of Neocortical Microcircuitry , 2015, Cell.

[7]  Henry Markram,et al.  Models of Neocortical Layer 5b Pyramidal Cells Capturing a Wide Range of Dendritic and Perisomatic Active Properties , 2011, PLoS Comput. Biol..

[8]  Henry Markram,et al.  A Novel Multiple Objective Optimization Framework for Constraining Conductance-Based Neuron Models by Experimental Data , 2007, Front. Neurosci..

[9]  S. Sisson,et al.  A comparative review of dimension reduction methods in approximate Bayesian computation , 2012, 1202.3819.

[10]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[11]  James G. Scott,et al.  Bayesian Inference for Logistic Models Using Pólya–Gamma Latent Variables , 2012, 1205.0310.

[12]  Eve Marder,et al.  Alternative to hand-tuning conductance-based models: construction and analysis of databases of model neurons. , 2003, Journal of neurophysiology.

[13]  Iain Murray,et al.  Fast $\epsilon$-free Inference of Simulation Models with Bayesian Conditional Density Estimation , 2016 .

[14]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[15]  Michael L. Hines,et al.  The NEURON Book , 2006 .

[16]  M. Gutmann,et al.  Fundamentals and Recent Developments in Approximate Bayesian Computation , 2016, Systematic biology.

[17]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[18]  Mike West,et al.  Sequential Monte Carlo with Adaptive Weights for Approximate Bayesian Computation , 2015, 1503.07791.

[19]  Scott W. Linderman,et al.  Bayesian latent structure discovery from multi-neuron recordings , 2016, NIPS.

[20]  S. Wood Statistical inference for noisy nonlinear ecological dynamic systems , 2010, Nature.

[21]  Robert Leenders,et al.  Hamiltonian ABC , 2015, UAI.

[22]  Bertrand Fontaine,et al.  Fitting Neuron Models to Spike Trains , 2011, Front. Neurosci..

[23]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[24]  Giuseppe De Nicolao,et al.  Nonparametric input estimation in physiological systems: Problems, methods, and case studies , 1997, Autom..

[25]  D. J. Nott,et al.  Approximate Bayesian computation via regression density estimation , 2012, 1212.1479.

[26]  Szabolcs Káli,et al.  A flexible, interactive software tool for fitting the parameters of neuronal models , 2014, Front. Neuroinform..

[27]  Richard Wilkinson,et al.  Accelerating ABC methods using Gaussian processes , 2014, AISTATS.

[28]  Richard E. Turner,et al.  Neural Adaptive Sequential Monte Carlo , 2015, NIPS.

[29]  Felipe Gerhard,et al.  On the stability and dynamics of stochastic spiking neuron models: Nonlinear Hawkes process and point process GLMs , 2017, PLoS Comput. Biol..

[30]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Max Welling,et al.  GPS-ABC: Gaussian Process Surrogate Approximate Bayesian Computation , 2014, UAI.

[32]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[33]  Henry Markram,et al.  Minimal Hodgkin–Huxley type models for different classes of cortical and thalamic neurons , 2008, Biological Cybernetics.

[34]  Alex Graves,et al.  Practical Variational Inference for Neural Networks , 2011, NIPS.

[35]  Scott W. Linderman,et al.  Using computational theory to constrain statistical models of neural data , 2017, Current Opinion in Neurobiology.

[36]  Aki Vehtari,et al.  Efficient Acquisition Rules for Model-Based Approximate Bayesian Computation , 2017, Bayesian Analysis.

[37]  Geoffrey E. Hinton,et al.  Keeping the neural networks simple by minimizing the description length of the weights , 1993, COLT '93.

[38]  Andreas Huth,et al.  Statistical inference for stochastic simulation models--theory and application. , 2011, Ecology letters.

[39]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[40]  Liang Meng,et al.  A sequential Monte Carlo approach to estimate biophysical neural models from spikes , 2011, Journal of neural engineering.

[41]  Olivier François,et al.  Non-linear regression models for Approximate Bayesian Computation , 2008, Stat. Comput..

[42]  Aidan C. Daly,et al.  Hodgkin–Huxley revisited: reparametrization and identifiability analysis of the classic action potential model with approximate Bayesian methods , 2015, Royal Society Open Science.

[43]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[44]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[45]  Maneesh Sahani,et al.  Inhibitory control of correlated intrinsic variability in cortical networks , 2016 .

[46]  Christopher C. Drovandi,et al.  Variational Bayes with synthetic likelihood , 2016, Statistics and Computing.

[47]  Hao Huang,et al.  Estimating parameters and predicting membrane voltages with conductance-based neuron models , 2014, Biological Cybernetics.

[48]  Nikil Dutt,et al.  An efficient automated parameter tuning framework for spiking neural networks , 2014, Front. Neurosci..

[49]  Henry Markram,et al.  BluePyOpt: Leveraging Open Source Software and Cloud Infrastructure to Optimise Model Parameters in Neuroscience , 2016, Front. Neuroinform..