Path statistics, memory, and coarse-graining of continuous-time random walks on networks.

Continuous-time random walks (CTRWs) on discrete state spaces, ranging from regular lattices to complex networks, are ubiquitous across physics, chemistry, and biology. Models with coarse-grained states (for example, those employed in studies of molecular kinetics) or spatial disorder can give rise to memory and non-exponential distributions of waiting times and first-passage statistics. However, existing methods for analyzing CTRWs on complex energy landscapes do not address these effects. Here we use statistical mechanics of the nonequilibrium path ensemble to characterize first-passage CTRWs on networks with arbitrary connectivity, energy landscape, and waiting time distributions. Our approach can be applied to calculating higher moments (beyond the mean) of path length, time, and action, as well as statistics of any conservative or non-conservative force along a path. For homogeneous networks, we derive exact relations between length and time moments, quantifying the validity of approximating a continuous-time process with its discrete-time projection. For more general models, we obtain recursion relations, reminiscent of transfer matrix and exact enumeration techniques, to efficiently calculate path statistics numerically. We have implemented our algorithm in PathMAN (Path Matrix Algorithm for Networks), a Python script that users can apply to their model of choice. We demonstrate the algorithm on a few representative examples which underscore the importance of non-exponential distributions, memory, and coarse-graining in CTRWs.

[1]  Campbell,et al.  Nonexponential relaxation in spin glasses and glassy systems. , 1988, Physical review. B, Condensed matter.

[2]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[3]  J. Douglas Aspects and applications of the random walk , 1995 .

[4]  C. Schütte,et al.  Supplementary Information for “ Constructing the Equilibrium Ensemble of Folding Pathways from Short Off-Equilibrium Simulations ” , 2009 .

[5]  Shlomi Reuveni,et al.  Role of substrate unbinding in Michaelis–Menten enzymatic reactions , 2014, Proceedings of the National Academy of Sciences.

[6]  Erik M. Bollt,et al.  What is Special about Diffusion on Scale-Free Nets? , 2004 .

[7]  Eric Vanden-Eijnden,et al.  Transition Path Theory for Markov Jump Processes , 2009, Multiscale Model. Simul..

[8]  R. Silbey,et al.  Properties of the generalized master equation: Green's functions and probability density functions in the path representation. , 2007, The Journal of chemical physics.

[9]  N. Goel,et al.  Stochastic models in biology , 1975 .

[10]  Sean X. Sun,et al.  Path ensembles and path sampling in nonequilibrium stochastic systems. , 2007, The Journal of chemical physics.

[11]  Pereyra,et al.  Dependence of the diffusion coefficient on the energy distribution of random barriers. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[12]  J. Klafter,et al.  Closed-form solutions for continuous time random walks on finite chains. , 2005, Physical review letters.

[13]  C. Thompson The Statistical Mechanics of Phase Transitions , 1978 .

[14]  I. Nemenman,et al.  The simplicity of completion time distributions for common complex biochemical processes , 2009, Physical biology.

[15]  Jin Wang,et al.  Potential landscape and flux framework of nonequilibrium networks: Robustness, dissipation, and coherence of biochemical oscillations , 2008, Proceedings of the National Academy of Sciences.

[16]  X. Xie,et al.  Protein Conformational Dynamics Probed by Single-Molecule Electron Transfer , 2003, Science.

[17]  Connected Network of Minima as a Model Glass: Long Time Dynamics , 1998, cond-mat/9803165.

[18]  Sidney Redner,et al.  A guide to first-passage processes , 2001 .

[19]  J. Hunter On the moments of Markov renewal processes , 1969, Advances in Applied Probability.

[20]  J. Klafter,et al.  First-passage times in complex scale-invariant media , 2007, Nature.

[21]  J. Stoyanov A Guide to First‐passage Processes , 2003 .

[22]  Shlomo Havlin,et al.  Exact-enumeration approach to random walks on percolation clusters in two dimensions , 1984 .

[23]  C. Peterson,et al.  Stem cell states, fates, and the rules of attraction. , 2009, Cell stem cell.

[24]  Kyle A. Beauchamp,et al.  Markov state model reveals folding and functional dynamics in ultra-long MD trajectories. , 2011, Journal of the American Chemical Society.

[25]  M. Manhart,et al.  Statistical Physics of Evolutionary Trajectories on Fitness Landscapes , 2013, 1305.1352.

[26]  Michael Frankfurter,et al.  Numerical Recipes In C The Art Of Scientific Computing , 2016 .

[27]  M. Gruebele,et al.  Observation of strange kinetics in protein folding. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[28]  David D. Yao First-passage-time moments of Markov processes , 1985 .

[29]  Joseph W. Haus,et al.  Diffusion in regular and disordered lattices , 1987 .

[30]  E. Montroll,et al.  Random Walks on Lattices. II , 1965 .

[31]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[32]  Frank Noé,et al.  Markov models of molecular kinetics: generation and validation. , 2011, The Journal of chemical physics.

[33]  S. Havlin,et al.  Scaling theory of transport in complex biological networks , 2007, Proceedings of the National Academy of Sciences.

[34]  G. Weiss,et al.  Use of comb-like models to mimic anomalous diffusion on fractal structures , 1987 .

[35]  Michael Manhart,et al.  Path-based approach to random walks on networks characterizes how proteins evolve new functions. , 2013, Physical review letters.

[36]  W. Coffey,et al.  Diffusion and Reactions in Fractals and Disordered Systems , 2002 .

[37]  Sean X. Sun Path summation formulation of the master equation. , 2006, Physical review letters.

[38]  R. Silbey,et al.  Path-probability density functions for semi-Markovian random walks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Michael Manhart,et al.  Protein folding and binding can emerge as evolutionary spandrels through structural coupling , 2014, Proceedings of the National Academy of Sciences.

[40]  A. A. Filyukov,et al.  Method of the most probable path of evolution in the theory of stationary irreversible processes , 1967 .

[41]  M. Lässig,et al.  Fitness flux and ubiquity of adaptive evolution , 2010, Proceedings of the National Academy of Sciences.

[42]  C. Curtis Linear Algebra: An Introductory Approach , 1984 .

[43]  Peter G. Harrison,et al.  Passage time distributions in large Markov chains , 2002, SIGMETRICS '02.

[44]  A. Iomin,et al.  Toy model of fractional transport of cancer cells due to self-entrapping. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Mircea Cotlet,et al.  Stretched exponential decay and correlations in the catalytic activity of fluctuating single lipase molecules. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[46]  L. Comtet,et al.  Advanced Combinatorics: The Art of Finite and Infinite Expansions , 1974 .

[47]  Nigel F. Delaney,et al.  Darwinian Evolution Can Follow Only Very Few Mutational Paths to Fitter Proteins , 2006, Science.

[48]  James J. Collins,et al.  Epigenetic Landscapes Explain Partially Reprogrammed Cells and Identify Key Reprogramming Genes , 2012, PLoS Comput. Biol..