Moment Closure—A Brief Review

Moment closure methods appear in myriad scientific disciplines in the modelling of complex systems. The goal is to achieve a closed form of a large, usually even infinite, set of coupled differential (or difference) equations. Each equation describes the evolution of one “moment”, a suitable coarse-grained quantity computable from the full state space. If the system is too large for analytical and/or numerical methods, then one aims to reduce it by finding a moment closure relation expressing “higher-order moments” in terms of “lower-order moments”. In this brief review, we focus on highlighting how moment closure methods occur in different contexts. We also conjecture via a geometric explanation why it has been difficult to rigorously justify many moment closure approximations although they work very well in practice.

[1]  J. Norris,et al.  Differential equation approximations for Markov chains , 2007, 0710.3269.

[2]  S. Redner,et al.  Voter model on heterogeneous graphs. , 2004, Physical review letters.

[3]  Bartlomiej Blaszczyszyn,et al.  Factorial moment expansion for stochastic systems , 1995 .

[4]  T. Hillen.  ON THE L 2 -MOMENT CLOSURE OF TRANSPORT EQUATIONS: THE GENERAL CASE , 2005 .

[5]  Thilo Gross,et al.  Adaptive coevolutionary networks: a review , 2007, Journal of The Royal Society Interface.

[6]  Ulf Dieckmann,et al.  On moment closures for population dynamics in continuous space. , 2004, Journal of theoretical biology.

[7]  T. Kurtz.  Solutions of ordinary differential equations as limits of pure jump markov processes , 1970, Journal of Applied Probability.

[8]  Stephen Baigent,et al.  A nonlinear dynamics perspective of moment closure for stochastic processes , 2001 .

[9]  Alain Barrat,et al.  Who's talking first? Consensus or lack thereof in coevolving opinion formation models. , 2007, Physical review letters.

[10]  Thilo Gross,et al.  Analytical calculation of fragmentation transitions in adaptive networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  C. Gillespie.  Moment-closure approximations for mass-action models. , 2009, IET systems biology.

[12]  V. V. Bolotin,et al.  Random vibrations of elastic systems , 1984 .

[13]  Balasubramanya T. Nadiga,et al.  MOMENT REALIZABILITY AND THE VALIDITY OF THE NAVIER-STOKES EQUATIONS FOR RAREFIED GAS DYNAMICS , 1998 .

[14]  Henning Struchtrup,et al.  An Extended Moment Method in Radiative Transfer: The Matrices of Mean Absorption and Scattering Coefficients , 1997 .

[15]  B. Bolker,et al.  Spatial Moment Equations for Plant Competition: Understanding Spatial Strategies and the Advantages of Short Dispersal , 1999, The American Naturalist.

[16]  S. Navarro-Martinez,et al.  Conditional Moment Closure for Large Eddy Simulations , 2005 .

[17]  R. Kikuchi.  A Theory of Cooperative Phenomena , 1951 .

[18]  T. Christen,et al.  Entropy production moment closures and effective transport coefficients , 2014 .

[19]  Manuel Torrilhon,et al.  Regularized 13-moment equations: shock structure calculations and comparison to Burnett models , 2004, Journal of Fluid Mechanics.

[20]  Christian Kuehn,et al.  A Mathematical Framework for Critical Transitions: Normal Forms, Variance and Applications , 2011, J. Nonlinear Sci..

[21]  Istvan Z Kiss,et al.  Epidemic spread in networks: Existing methods and current challenges. , 2014, Mathematical modelling of natural phenomena.

[22]  Mikael Mortensen,et al.  Derivation of the conditional moment closure equations for spray combustion , 2009 .

[23]  A. Nunes,et al.  Fluctuations and oscillations in a simple epidemic model. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Glenn Marion,et al.  Novel bivariate moment-closure approximations. , 2007, Mathematical biosciences.

[25]  Carlo Cercignani,et al.  Mathematical Methods in Kinetic Theory , 1970 .

[26]  H. Struchtrup.  Macroscopic transport equations for rarefied gas flows , 2005 .

[27]  Thilo Gross,et al.  Cyclic dominance in adaptive networks , 2011 .

[28]  S. Redner,et al.  A Kinetic View of Statistical Physics , 2010 .

[29]  François Golse,et al.  The Navier–Stokes limit of the Boltzmann equation for bounded collision kernels , 2004 .

[30]  Clinton P. T. Groth,et al.  Towards realizable hyperbolic moment closures for viscous heat-conducting gas flows based on a maximum-entropy distribution , 2013 .

[31]  Linda J. S. Allen,et al.  Comparison of Markov Chain and Stochastic Differential Equation Population Models Under Higher-Order Moment Closure Approximations , 2010 .

[32]  Joel C. Miller.  A note on a paper by Erik Volz: SIR dynamics in random networks , 2009, Journal of mathematical biology.

[33]  Ingemar Nåsell,et al.  Moment closure and the stochastic logistic model. , 2003, Theoretical population biology.

[34]  M N,et al.  The Evolution of Cooperation in a Lattice-Structured Population , 1996 .

[35]  Matt J. Keeling,et al.  A Motif-Based Approach to Network Epidemics , 2009, Bulletin of mathematical biology.

[36]  B. Bolker,et al.  Using Moment Equations to Understand Stochastically Driven Spatial Pattern Formation in Ecological Systems , 1997, Theoretical population biology.

[37]  Simon A. Levin,et al.  The Geometry of Ecological Interactions: Moment Methods for Ecological Processes in Continuous Space , 2000 .

[38]  Akira Sasaki,et al.  Statistical Mechanics of Population: The Lattice Lotka-Volterra Model , 1992 .

[39]  David Cai,et al.  Maximum-entropy closures for kinetic theories of neuronal network dynamics. , 2006, Physical review letters.

[40]  Thomas House,et al.  Exact and approximate moment closures for non-Markovian network epidemics. , 2015, Journal of theoretical biology.

[41]  K. Hausken,et al.  A closure approximation technique for epidemic models , 2010 .

[42]  Thomas House,et al.  From Markovian to pairwise epidemic models and the performance of moment closure approximations , 2012, Journal of mathematical biology.

[43]  H. Struchtrup,et al.  Regularization of Grad’s 13 moment equations: Derivation and linear analysis , 2003 .

[44]  M. Bartlett,et al.  A comparison of theoretical and empirical results for some stochastic population models , 1960 .

[45]  C. David Levermore,et al.  The Gaussian Moment Closure for Gas Dynamics , 1998, SIAM J. Appl. Math..

[46]  D. Williams.  STOCHASTIC DIFFERENTIAL EQUATIONS: THEORY AND APPLICATIONS , 1976 .

[47]  Ira B Schwartz,et al.  Fluctuating epidemics on adaptive networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  A. M. Hasofer,et al.  A New Perspective on the Moment Closure Method , 1995 .

[49]  T. Elmroth.  Global boundedness of moments of solutions of the Boltzmann equation for forces of infinite range , 1983 .

[50]  Maia Martcheva,et al.  Kolmogorov’s Differential Equations and Positive Semigroups on First Moment Sequence Spaces , 2006, Journal of mathematical biology.

[51]  T. Gross,et al.  Moment-Closure Approximations for Discrete Adaptive Networks , 2012, 1211.0449.

[52]  Laurent Desvillettes,et al.  Some applications of the method of moments for the homogeneous Boltzmann and Kac equations , 1993 .

[53]  D. Rand,et al.  Correlation models for childhood epidemics , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[54]  Yanping Lin,et al.  On the $L^2$-moment closure of transport equations: The Cattaneo approximation , 2004 .

[55]  H. Spohn.  Kinetic equations from Hamiltonian dynamics: Markovian limits , 1980 .

[56]  Ira B Schwartz,et al.  Enhanced vaccine control of epidemics in adaptive networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  L. A. Segel,et al.  The Quasi-Steady-State Assumption: A Case Study in Perturbation , 1989, SIAM Rev..

[58]  T. Kurtz.  Strong approximation theorems for density dependent Markov chains , 1978 .

[59]  Robert W. Bilger,et al.  Conditional moment closure for turbulent reacting flow , 1993 .

[60]  I. Kiss,et al.  Exact epidemic models on graphs using graph-automorphism driven lumping , 2010, Journal of mathematical biology.

[61]  J. Gleeson.  High-accuracy approximation of binary-state dynamics on networks. , 2011, Physical review letters.

[62]  Thilo Gross,et al.  Emergent bipartiteness in a society of knights and knaves , 2011, ArXiv.

[63]  João Pedro Hespanha,et al.  A Derivative Matching Approach to Moment Closure for the Stochastic Logistic Model , 2007, Bulletin of mathematical biology.

[64]  O. Kallenberg.  Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[65]  R. Bertram,et al.  Stochastic Systems , 2008, Control Theory for Physicists.

[66]  R. Bobryk.  Closure method and asymptotic expansions for linear stochastic systems , 2007 .

[67]  Thilo Gross,et al.  Epidemic dynamics on an adaptive network. , 2005, Physical review letters.

[68]  L. Meyers,et al.  When individual behaviour matters: homogeneous and network models in epidemiology , 2007, Journal of The Royal Society Interface.

[69]  Thilo Gross,et al.  Robust oscillations in SIS epidemics on adaptive networks: Coarse graining by automated moment closure , 2008 .

[70]  P. Driessche,et al.  Effective degree network disease models , 2011, Journal of mathematical biology.

[71]  Pierre-André Noël,et al.  Time evolution of epidemic disease on finite and infinite networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[72]  Matt J Keeling,et al.  Modeling dynamic and network heterogeneities in the spread of sexually transmitted diseases , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Otso Ovaskainen,et al.  Space and stochasticity in population dynamics , 2006, Proceedings of the National Academy of Sciences.

[74]  Paolo De Los Rios,et al.  Cluster approximations for epidemic processes: a systematic description of correlations beyond the pair level. , 2004, Journal of theoretical biology.

[75]  Ulf Dieckmann,et al.  A multiscale maximum entropy moment closure for locally regulated space–time point process models of population dynamics , 2011, Journal of mathematical biology.

[76]  I. Csiszár.  Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[77]  Daichi Kimura,et al.  Coevolutionary networks with homophily and heterophily. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[78]  Ulf Dieckmann,et al.  Relaxation Projections and the Method of Moments , 1999 .

[79]  T. House.  Algebraic Moment Closure for Population Dynamics on Discrete Structures , 2014, Bulletin of mathematical biology.

[80]  G. Verghese,et al.  Mass fluctuation kinetics: capturing stochastic effects in systems of chemical reactions through coupled mean-variance computations. , 2007, The Journal of chemical physics.

[81]  G. J. Gibson,et al.  Comparing approximations to spatio-temporal models for epidemics with local spread , 2001, Bulletin of mathematical biology.

[82]  Michael Taylor,et al.  An effective degree model for epidemics on dynamic networks , 2011 .

[83]  J. Cernohorsky,et al.  Maximum entropy distribution and closure for Bose-Einstein and Fermi-Dirac radiation transport , 1994 .

[84]  Earl H. Dowell,et al.  Parametric Random Vibration , 1985 .

[85]  Emanuele Pugliese,et al.  Heterogeneous pair approximation for voter models on networks , 2009, 0903.5489.

[86]  M. Keeling,et al.  The effects of local spatial structure on epidemiological invasions , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[87]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[88]  Ulf Dieckmann,et al.  Moment Approximations of Individual-based Models , 1999 .

[89]  T. Rogers.  Maximum-entropy moment-closure for stochastic systems on networks , 2011, 1103.4980.

[90]  Perkins,et al.  Fluid moment models for Landau damping with application to the ion-temperature-gradient instability. , 1990, Physical review letters.

[91]  Chang Hyeong Lee,et al.  A moment closure method for stochastic reaction networks. , 2009, The Journal of chemical physics.

[92]  James H. Matis,et al.  ON APPROXIMATING THE MOMENTS OF THE EQUILIBRIUM DISTRIBUTION OF A STOCHASTIC LOGISTIC MODEL , 1996 .

[93]  D. Zanette,et al.  Infection Spreading in a Population with Evolving Contacts , 2007, Journal of biological physics.

[94]  Arne Traulsen,et al.  Coevolution of strategy and structure in complex networks with dynamical linking. , 2006, Physical review letters.

[95]  Matt J. Keeling,et al.  Insights from unifying modern approximations to infections on networks , 2010, Journal of The Royal Society Interface.

[96]  Baruch Barzel,et al.  Stochastic analysis of complex reaction networks using binomial moment equations. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[97]  F. Vazquez,et al.  Analytical solution of the voter model on uncorrelated networks , 2008, 0803.1686.

[98]  G. J. Gibson,et al.  Studying and approximating spatio–temporal models for epidemic spread and control , 1998 .

[99]  L. Meyers,et al.  Susceptible–infected–recovered epidemics in dynamic contact networks , 2007, Proceedings of the Royal Society B: Biological Sciences.

[100]  Frank Diederich,et al.  Mathematical Epidemiology Of Infectious Diseases Model Building Analysis And Interpretation , 2016 .

[101]  David Hiebeler,et al.  Moment Equations and Dynamics of a Household SIS Epidemiological Model , 2006, Bulletin of mathematical biology.

[102]  Damián H Zanette,et al.  Contact switching as a control strategy for epidemic outbreaks. , 2008, Journal of theoretical biology.

[103]  Jeremy T. Bradley,et al.  Higher Moment Analysis of a Spatial Stochastic Process Algebra , 2011, EPEW.

[104]  Jeremy T. Bradley,et al.  Moment Closures for Performance Models with Highly Non-linear Rates , 2012, EPEW/UKPEW.

[105]  Sergey Melnik,et al.  Accuracy of mean-field theory for dynamics on real-world networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[106]  Rafail V. Abramov,et al.  An improved algorithm for the multidimensional moment-constrained maximum entropy problem , 2007, J. Comput. Phys..

[107]  Istvan Z. Kiss,et al.  New Moment Closures Based on A Priori Distributions with Applications to Epidemic Dynamics , 2012, Bulletin of mathematical biology.

[108]  T. Hillen.  M5 mesoscopic and macroscopic models for mesenchymal motion , 2006, Journal of mathematical biology.

[109]  W. Ebeling.  Stochastic Processes in Physics and Chemistry , 1995 .

[110]  A. Singer,et al.  Maximum entropy formulation of the Kirkwood superposition approximation. , 2004, The Journal of chemical physics.

[111]  Long Wang,et al.  Partner switching stabilizes cooperation in coevolutionary prisoner's dilemma. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[112]  M. Keeling,et al.  Networks and epidemic models , 2005, Journal of The Royal Society Interface.

[113]  F. Hagen.  MOMENT EQUATIONS AND HERMITE EXPANSION FOR NONLINEAR STOCHASTIC DIFFERENTIAL EQUATIONS WITH APPLICATION TO STOCK PRICE MODELS , 2004 .

[114]  Christopher Jones,et al.  Geometric singular perturbation theory , 1995 .

[115]  Thomas House,et al.  Endemic infections are always possible on regular networks , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[116]  J. Kirkwood.  Statistical Mechanics of Fluid Mixtures , 1935 .

[117]  David A. Rand,et al.  Correlation Equations and Pair Approximations for Spatial Ecologies , 1999 .

[118]  L. Hébert-Dufresne,et al.  Adaptive networks: Coevolution of disease and topology. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[119]  A. Plastino,et al.  The nonlinear Fokker-Planck equation with state-dependent diffusion - a nonextensive maximum entropy approach , 1999 .

[120]  Jean-Baptiste Ferdy,et al.  Extinction times and moment closure in the stochastic logistic process. , 2004, Theoretical population biology.

[121]  S. Mischler,et al.  Kac’s program in kinetic theory , 2011, Inventiones mathematicae.

[122]  R. Bilger,et al.  Conditional moment closure (CMC) predictions of a turbulent methane-air jet flame , 2001 .

[123]  Akira Sasaki,et al.  Pathogen invasion and host extinction in lattice structured populations , 1994, Journal of mathematical biology.

[124]  Péter L. Simon,et al.  Differential equation approximations of stochastic network processes: An operator semigroup approach , 2011, Networks Heterog. Media.

[125]  J. Matis,et al.  Effects of immigration on some stochastic logistic models: a cumulant truncation analysis. , 1999, Theoretical population biology.

[126]  S. Bornholdt,et al.  Topological evolution of dynamical networks: global criticality from local dynamics. , 2000, Physical review letters.

[127]  Axel Klar,et al.  Partial Moment Entropy Approximation to Radiative Heat Transfer , 2005 .

[128]  C. Cercignani.  The Boltzmann equation and its applications , 1988 .

[129]  C. Kuehn.  Time-scale and noise optimality in self-organized critical adaptive networks. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[130]  J. Gleeson.  Binary-state dynamics on complex networks: pair approximation and beyond , 2012, 1209.2983.

[131]  C. Groth,et al.  Towards physically realizable and hyperbolic moment closures for kinetic theory , 2009 .

[132]  E. Baake,et al.  Moment closure in a Moran model with recombination , 2011, 1105.0793.

[133]  C. D. Levermore,et al.  Moment closure hierarchies for kinetic theories , 1996 .

[134]  Thilo Gross,et al.  Exploring the adaptive voter model dynamics with a mathematical triple jump , 2013, 1302.2743.

[135]  Neil Fenichel.  Geometric singular perturbation theory for ordinary differential equations , 1979 .

[136]  G. Gibson,et al.  Novel moment closure approximations in stochastic epidemics , 2005, Bulletin of mathematical biology.

[137]  C. Kuehn.  Multiple Time Scale Dynamics , 2015 .

[138]  Ingemar Nåsell,et al.  An extension of the moment closure method. , 2003, Theoretical population biology.

[139]  Baruch Barzel,et al.  Binomial moment equations for stochastic reaction systems. , 2011, Physical review letters.

[140]  P. Whittle.  On the Use of the Normal Approximation in the Treatment of Stochastic Processes , 1957 .

[141]  M J Keeling,et al.  Multiplicative moments and measures of persistence in ecology. , 2000, Journal of theoretical biology.

[142]  Chris T Bauch,et al.  The spread of infectious diseases in spatially structured populations: an invasory pair approximation. , 2005, Mathematical biosciences.

[143]  James Paul Holloway,et al.  One-dimensional Riemann solvers and the maximum entropy closure , 2001 .

[144]  Stefan Engblom,et al.  Computing the moments of high dimensional solutions of the master equation , 2006, Appl. Math. Comput..

[145]  Leslaw Socha.  Linearization Methods for Stochastic Dynamic Systems , 2008 .

[146]  Robert Robson,et al.  Colloquium : Physically based fluid modeling of collisionally dominated low-temperature plasmas , 2005 .

[147]  Mason A. Porter,et al.  Dynamical Systems on Networks: A Tutorial , 2014, ArXiv.

[148]  S. Ellner,et al.  Pair approximation for lattice models with multiple interaction scales. , 2001, Journal of theoretical biology.

[149]  A. Klimenko,et al.  Conditional moment closure for turbulent combustion , 1999 .

[150]  H. Grad.  On the kinetic theory of rarefied gases , 1949 .

[151]  A. Klimenko,et al.  Note on the conditional moment closure in turbulent shear flows , 1995 .