Identifiability of a Binomial Synapse

Synapses are highly stochastic transmission units. A classical model describing this stochastic transmission is called the binomial model, and its underlying parameters can be estimated from postsynaptic responses to evoked stimuli. The accuracy of parameter estimates obtained via such a model-based approach depends on the identifiability of the model. A model is said to be structurally identifiable if its parameters can be uniquely inferred from the distribution of its outputs. However, this theoretical property does not necessarily imply practical identifiability. For instance, if the number of observations is low or if the recording noise is high, the model's parameters can only be loosely estimated. Structural identifiability, which is an intrinsic property of a model, has been widely characterized; but practical identifiability, which is a property of both the model and the experimental protocol, is usually only qualitatively assessed. Here, we propose a formal definition for the practical identifiability domain of a statistical model. For a given experimental protocol, this domain corresponds to the set of parameters for which the model is correctly identified as the ground truth compared to a simpler alternative model. Considering a model selection problem instead of a parameter inference problem allows to derive a non-arbitrary criterion for practical identifiability. We apply our definition to the study of neurotransmitter release at a chemical synapse. Our contribution to the analysis of synaptic stochasticity is three-fold: firstly, we propose a quantitative criterion for the practical identifiability of a statistical model, and compute the identifiability domains of different variants of the binomial release model (uni or multi-quantal, with or without short-term plasticity); secondly, we extend the Bayesian Information Criterion (BIC), a classically used tool for model selection, to models with correlated data (which is the case for most models of chemical synapses); finally, we show that our approach allows to perform data free model selection, i.e., to verify if a model used to fit data was indeed identifiable even without access to the data, but having only access to the fitted parameters.

[1]  Xun Huan,et al.  Simulation-based optimal Bayesian experimental design for nonlinear systems , 2011, J. Comput. Phys..

[2]  B. Katz,et al.  Quantal components of the end‐plate potential , 1954, The Journal of physiology.

[3]  C O Dotson,et al.  Analysis of Change , 1973, Exercise and sport sciences reviews.

[4]  Shinsuke Koyama,et al.  Coding efficiency and detectability of rate fluctuations with non-Poisson neuronal firing , 2012, NIPS.

[5]  Robert C. MacCallum,et al.  Current topics in the theory and application of latent variable models , 2012 .

[6]  Michael P H Stumpf,et al.  Sensitivity, robustness, and identifiability in stochastic chemical kinetics models , 2011, Proceedings of the National Academy of Sciences.

[7]  Wulfram Gerstner,et al.  A benchmark test for a quantitative assessment of simple neuron models , 2008, Journal of Neuroscience Methods.

[8]  Rui Ponte Costa,et al.  Correction: Unified pre- and postsynaptic long-term plasticity enables reliable and flexible learning , 2015, eLife.

[9]  Shigeru Shinomoto,et al.  Made-to-Order Spiking Neuron Model Equipped with a Multi-Timescale Adaptive Threshold , 2009, Front. Comput. Neurosci..

[10]  G S Bhumbra,et al.  Reliable evaluation of the quantal determinants of synaptic efficacy using Bayesian analysis. , 2013, Journal of neurophysiology.

[11]  Peter A. J. Hilbers,et al.  Optimal experiment design for model selection in biochemical networks , 2014, BMC Systems Biology.

[12]  Ursula Klingmüller,et al.  Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood , 2009, Bioinform..

[13]  R. Malenka,et al.  Synaptic plasticity and addiction , 2007, Nature Reviews Neuroscience.

[14]  Igor Delvendahl,et al.  Dysbindin links presynaptic proteasome function to homeostatic recruitment of low release probability vesicles , 2018, Nature Communications.

[15]  Mark C. W. van Rossum,et al.  Probabilistic inference of short-term synaptic plasticity in neocortical microcircuits , 2013, Front. Comput. Neurosci..

[16]  Ralf Schneggenburger,et al.  Intracellular calcium dependence of transmitter release rates at a fast central synapse , 2000, Nature.

[17]  Jay I. Myung,et al.  Assessing the distinguishability of models and the informativeness of data , 2004, Cognitive Psychology.

[18]  Daqing Guo,et al.  Stochastic resonance in Hodgkin-Huxley neuron induced by unreliable synaptic transmission. , 2012, Journal of theoretical biology.

[19]  Alejandro Fernández Villaverde,et al.  Finding and Breaking Lie Symmetries: Implications for Structural Identifiability and Observability in Biological Modelling , 2020, Symmetry.

[20]  S. Dudek,et al.  Cortico-striatal synaptic defects and OCD-like behaviours in Sapap3-mutant mice , 2007, Nature.

[21]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[22]  S. Moolgavkar,et al.  A Method for Computing Profile-Likelihood- Based Confidence Intervals , 1988 .

[23]  Luigi Acerbi,et al.  A Framework for Testing Identifiability of Bayesian Models of Perception , 2014, NIPS.

[24]  E. Wagenmakers,et al.  Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method , 2010, Cognitive Psychology.

[25]  Eve Marder,et al.  Ion channel degeneracy enables robust and tunable neuronal firing rates , 2015, Proceedings of the National Academy of Sciences.

[26]  W. Gerstner,et al.  Parameter extraction and classification of three cortical neuron types reveals two distinct adaptation mechanisms. , 2012, Journal of neurophysiology.

[27]  Wulfram Gerstner,et al.  How Good Are Neuron Models? , 2009, Science.

[28]  Brad E. Pfeiffer,et al.  The State of Synapses in Fragile X Syndrome , 2009, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[29]  Martin D. Weinberg,et al.  Computing the Bayes Factor from a Markov chain Monte Carlo Simulation of the Posterior Distribution , 2009, 0911.1777.

[30]  W. Jefferys Sharpening Ockham ' s Razor on a Bayesian Strop ( Key terms : Bayes ' theorem ; Ockham ' s razor ) , 1991 .

[31]  Jean-Pascal Pfister,et al.  Model-Based Inference of Synaptic Transmission , 2019, Front. Synaptic Neurosci..

[32]  J. Simpson THE RELEASE OF NEURAL TRANSMITTER SUBSTANCES , 1969 .

[33]  Petr Lansky,et al.  Performance breakdown in optimal stimulus decoding , 2015, Journal of neural engineering.

[34]  Alexander Bird,et al.  Bayesian Inference of Synaptic Quantal Parameters from Correlated Vesicle Release , 2016, Front. Comput. Neurosci..

[35]  G. C. Pomraning A Method for Computing , 1965 .

[36]  T. Südhof,et al.  A dual-Ca2+-sensor model for neurotransmitter release in a central synapse , 2007, Nature.

[37]  Ian H. Stevenson,et al.  Modeling the Short-Term Dynamics of in Vivo Excitatory Spike Transmission , 2020, The Journal of Neuroscience.

[38]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[39]  Tao Wang,et al.  A Phenomenological Synapse Model for Asynchronous Neurotransmitter Release , 2016, Front. Comput. Neurosci..

[40]  J. Spall Monte Carlo Computation of the Fisher Information Matrix in Nonstandard Settings , 2005 .

[41]  David R. Anderson,et al.  Understanding AIC and BIC in Model Selection , 2004 .

[42]  G. Davis,et al.  Homeostatic control of presynaptic neurotransmitter release. , 2015, Annual review of physiology.

[43]  P. Calabresi,et al.  A convergent model for cognitive dysfunctions in Parkinson's disease: the critical dopamine–acetylcholine synaptic balance , 2006, The Lancet Neurology.

[44]  Rui Ponte Costa,et al.  Unified pre- and postsynaptic long-term plasticity enables reliable and flexible learning , 2015, eLife.

[45]  Sandro Macchietto,et al.  Statistical tools for optimal dynamic model building , 2000 .

[46]  Charles F Stevens,et al.  Synaptic plasticity , 1998, Current Biology.

[47]  Beatriz E. P. Mizusaki,et al.  Functional consequences of pre- and postsynaptic expression of synaptic plasticity , 2016, bioRxiv.

[48]  T. Vogels,et al.  Synaptic Transmission Optimization Predicts Expression Loci of Long-Term Plasticity , 2017, Neuron.

[49]  Christoph Riedl,et al.  Fast Model-Selection through Adapting Design of Experiments Maximizing Information Gain , 2018, ArXiv.

[50]  Gianluigi Mongillo,et al.  Quantifying Repetitive Transmission at Chemical Synapses: A Generative-Model Approach123 , 2016, eNeuro.

[51]  D. Selkoe Alzheimer's Disease Is a Synaptic Failure , 2002, Science.

[52]  Daniel Levenstein,et al.  On the role of theory and modeling in neuroscience. , 2020 .

[53]  André Longtin,et al.  Inference of a Mesoscopic Population Model from Population Spike Trains , 2020, Neural Computation.

[54]  André Longtin,et al.  A phenomenological model for self-initiated movement in electric fish , 2014, BMC Neuroscience.

[55]  Freek E. Hoebeek,et al.  SLC26A11 (KBAT) in Purkinje Cells Is Critical for Inhibitory Transmission and Contributes to Locomotor Coordination , 2016, eNeuro.

[56]  R. Schneggenburger,et al.  Allosteric modulation of the presynaptic Ca2+ sensor for vesicle fusion , 2005, Nature.

[57]  William B Levy,et al.  Energy-Efficient Neuronal Computation via Quantal Synaptic Failures , 2002, The Journal of Neuroscience.

[58]  H. V. Trees,et al.  Bayesian Bounds for Parameter Estimation and Nonlinear Filtering/Tracking , 2007 .

[59]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[60]  Nathaniel D. Daw,et al.  Trial-by-trial data analysis using computational models , 2011 .

[61]  Karl J. Friston,et al.  Synaptic Plasticity and Dysconnection in Schizophrenia , 2006, Biological Psychiatry.

[62]  C. Stevens,et al.  Origin of variability in quantal size in cultured hippocampal neurons and hippocampal slices. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Konrad Grützmann,et al.  Author Correction: Variants in exons 5 and 6 of ACTB cause syndromic thrombocytopenia , 2018, Nature Communications.

[64]  Van Trees,et al.  Detection, Estimation, and Modulation Theory. Part 1 - Detection, Estimation, and Linear Modulation Theory. , 1968 .

[65]  J. Timmer,et al.  Addressing parameter identifiability by model-based experimentation. , 2011, IET systems biology.

[66]  C. Hoogenraad,et al.  Synapse Pathology in Psychiatric and Neurologic Disease , 2010, Current neurology and neuroscience reports.

[67]  Keegan E. Hines,et al.  Determination of parameter identifiability in nonlinear biophysical models: A Bayesian approach , 2014, The Journal of general physiology.

[68]  B. Katz,et al.  Spontaneous subthreshold activity at motor nerve endings , 1952, The Journal of physiology.

[69]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[70]  A. W. van der Vaart,et al.  On Profile Likelihood , 2000 .

[71]  Ian H. Stevenson,et al.  Estimating short-term synaptic plasticity from pre- and postsynaptic spiking , 2017, PLoS Comput. Biol..

[72]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[73]  .. W. V. Der,et al.  On Profile Likelihood , 2000 .

[74]  Rahul K Rathour,et al.  Degeneracy in hippocampal physiology and plasticity , 2017, bioRxiv.

[75]  T. Südhof Neuroligins and neurexins link synaptic function to cognitive disease , 2008, Nature.