Stochastic shielding and edge importance for Markov chains with timescale separation

Nerve cells produce electrical impulses (“spikes”) through the coordinated opening and closing of ion channels. Markov processes with voltage-dependent transition rates capture the stochasticity of spike generation at the cost of complex, time-consuming simulations. Schmandt and Galán introduced a novel method, based on the stochastic shielding approximation, as a fast, accurate method for generating approximate sample paths with excellent first and second moment agreement to exact stochastic simulations. We previously analyzed the mathematical basis for the method’s remarkable accuracy, and showed that for models with a Gaussian noise approximation, the stationary variance of the occupancy at each vertex in the ion channel state graph could be written as a sum of distinct contributions from each edge in the graph. We extend this analysis to arbitrary discrete population models with first-order kinetics. The resulting decomposition allows us to rank the “importance” of each edge’s contribution to the variance of the current under stationary conditions. In most cases, transitions between open (conducting) and closed (non-conducting) states make the greatest contributions to the variance, but there are exceptions. In a 5-state model of the nicotinic acetylcholine receptor, at low agonist concentration, a pair of “hidden” transitions (between two closed states) makes a greater contribution to the variance than any of the open-closed transitions. We exhaustively investigate this “edge importance reversal” phenomenon in simplified 3-state models, and obtain an exact formula for the contribution of each edge to the variance of the open state. Two conditions contribute to reversals: the opening rate should be faster than all other rates in the system, and the closed state leading to the opening rate should be sparsely occupied. When edge importance reversal occurs, current fluctuations are dominated by a slow noise component arising from the hidden transitions.

[1]  David Gfeller,et al.  Spectral coarse graining of complex networks. , 2007, Physical review letters.

[2]  Jae Kyoung Kim,et al.  Reduction of multiscale stochastic biochemical reaction networks using exact moment derivation , 2017, PLoS Comput. Biol..

[3]  Stefan Bornholdt,et al.  Detecting fuzzy community structures in complex networks with a Potts model. , 2004, Physical review letters.

[4]  R. Cowen,et al.  Larval dispersal and marine population connectivity. , 2009, Annual review of marine science.

[5]  M. A. Muñoz,et al.  Journal of Statistical Mechanics: An IOP and SISSA journal Theory and Experiment Detecting network communities: a new systematic and efficient algorithm , 2004 .

[6]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Heinz Koeppl,et al.  Uncoupled Analysis of Stochastic Reaction Networks in Fluctuating Environments , 2014, PLoS Comput. Biol..

[8]  S. Meyn,et al.  Phase transitions and metastability in Markovian and molecular systems , 2004 .

[9]  David Terman,et al.  Mathematical foundations of neuroscience , 2010 .

[10]  Johan Paulsson,et al.  Models of stochastic gene expression , 2005 .

[11]  Uri Alon,et al.  Coarse-graining and self-dissimilarity of complex networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  James D. Meiss,et al.  Differential dynamical systems , 2007, Mathematical modeling and computation.

[13]  Roberto F Galán,et al.  Stochastic-shielding approximation of Markov chains and its application to efficiently simulate random ion-channel gating. , 2012, Physical review letters.

[14]  David F. Anderson,et al.  Continuous Time Markov Chain Models for Chemical Reaction Networks , 2011 .

[15]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Peter J Thomas,et al.  Measuring Edge Importance: A Quantitative Analysis of the Stochastic Shielding Approximation for Random Processes on Graphs , 2013, Journal of mathematical neuroscience.

[17]  J. Stiles,et al.  The temperature sensitivity of miniature endplate currents is mostly governed by channel gating: evidence from optimized recordings and Monte Carlo simulations. , 1999, Biophysical journal.

[18]  W. McLean Strongly Elliptic Systems and Boundary Integral Equations , 2000 .

[19]  Haitao Yu,et al.  Effects of ion channel noise on neural circuits: an application to the respiratory pattern generator to investigate breathing variability. , 2017, Journal of neurophysiology.

[20]  J. Paulsson Summing up the noise in gene networks , 2004, Nature.

[21]  H. Risken Fokker-Planck Equation , 1996 .

[22]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[23]  Bard Ermentrout,et al.  Stochastic representations of ion channel kinetics and exact stochastic simulation of neuronal dynamics , 2014, Journal of Computational Neuroscience.

[24]  Alessandro Vespignani,et al.  K-core decomposition of Internet graphs: hierarchies, self-similarity and measurement biases , 2005, Networks Heterog. Media.

[25]  Daniel Soudry,et al.  Simple, Fast and Accurate Implementation of the Diffusion Approximation Algorithm for Stochastic Ion Channels with Multiple States , 2011, PloS one.

[26]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[27]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[28]  H. Othmer,et al.  A stochastic analysis of first-order reaction networks , 2005, Bulletin of mathematical biology.

[29]  Daniel Soudry,et al.  Diffusion approximation-based simulation of stochastic ion channels: which method to use? , 2014, Front. Comput. Neurosci..

[30]  K. Magleby,et al.  Zinc potentiates neuronal nicotinic receptors by increasing burst duration. , 2008, Journal of neurophysiology.

[31]  J. Hasty,et al.  Statistics of cellular signal transduction as a race to the nucleus by multiple random walkers in compartment/phosphorylation space , 2006, Proceedings of the National Academy of Sciences.

[32]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[33]  David A. Rand,et al.  Long-time analytic approximation of large stochastic oscillators: Simulation, analysis and inference , 2016, bioRxiv.

[34]  A. Hawkes,et al.  On the stochastic properties of bursts of single ion channel openings and of clusters of bursts. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[35]  T. Kurtz Approximation of Population Processes , 1987 .

[36]  C. Gardiner Stochastic Methods: A Handbook for the Natural and Social Sciences , 2009 .

[37]  Robin Wilson,et al.  Graph theory and combinatorics , 1979 .

[38]  J. Pearson,et al.  Using independent open-to-closed transitions to simplify aggregated Markov models of ion channel gating kinetics. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[39]  L. Walløe,et al.  Firing behaviour in a stochastic nerve membrane model based upon the Hodgkin-Huxley equations. , 1979, Acta physiologica Scandinavica.

[40]  Ghanim Ullah,et al.  Simplification of reversible Markov chains by removal of states with low equilibrium occupancy. , 2012, Journal of theoretical biology.

[41]  Paul C. Bressloff,et al.  Stochastic Processes in Cell Biology , 2014, Interdisciplinary Applied Mathematics.

[42]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[43]  Pavel Anatolyevich Puzerey,et al.  On how correlations between excitatory and inhibitory synaptic inputs maximize the information rate of neuronal firing , 2014, Front. Comput. Neurosci..

[44]  Glenn Vinnicombe,et al.  Noise in Gene Regulatory Networks , 2008, IEEE Transactions on Automatic Control.

[45]  A. Auerbach,et al.  Maximum likelihood estimation of aggregated Markov processes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[46]  T. Sixma,et al.  Crystal structure of an ACh-binding protein reveals the ligand-binding domain of nicotinic receptors , 2001, Nature.

[47]  David M. McCandlish,et al.  VISUALIZING FITNESS LANDSCAPES , 2011, Evolution; international journal of organic evolution.