Size Expansions of Mean Field Approximation

Mean field approximation is a powerful tool to study the performance of large stochastic systems that is known to be exact as the system's size N goes to infinity. Recently, it has been shown that, when one wants to compute expected performance metric in steady-state, mean field approximation can be made more accurate by adding a term in 1/N to the original approximation. This is called the refined mean field approximation in [7]. In this paper, we show how to obtain the same result for the transient regime and we provide a further refinement by expanding the term in 1/N2 (both for transient and steady-state regime). Our derivations are inspired by moment-closure approximation. We provide a number of examples that show this new approximation is usable in practice for systems with up to a few tens of dimensions.

[1]  James R. Larus,et al.  Join-Idle-Queue: A novel load balancing algorithm for dynamically scalable web services , 2011, Perform. Evaluation.

[2]  Nicolas Gast,et al.  Expected Values Estimated via Mean-Field Approximation are 1/N-Accurate , 2017, Proc. ACM Meas. Anal. Comput. Syst..

[3]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[4]  Darren J. Wilkinson.  Stochastic Modelling for Systems Biology , 2006 .

[5]  Michael P H Stumpf,et al.  A general moment expansion method for stochastic kinetic models. , 2013, The Journal of chemical physics.

[6]  Richard H. Bartels,et al.  Algorithm 432 [C2]: Solution of the matrix equation AX + XB = C [F4] , 1972, Commun. ACM.

[7]  Ronald Fagin,et al.  Asymptotic Miss Ratios over Independent References , 1977, J. Comput. Syst. Sci..

[8]  J. Dai,et al.  Stein's method for steady-state diffusion approximations: an introduction through the Erlang-A and Erlang-C models , 2015, 1512.09364.

[9]  Jean-Yves Le Boudec,et al.  A class of mean field interaction models for computer and communication systems , 2008, Perform. Evaluation.

[10]  C. Gillespie.  Moment-closure approximations for mass-action models. , 2009, IET systems biology.

[11]  Michael Mitzenmacher,et al.  The Power of Two Choices in Randomized Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[12]  Eitan Altman,et al.  Maximum Damage Malware Attack in Mobile Wireless Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[13]  Guido Sanguinetti,et al.  Validity conditions for moment closure approximations in stochastic chemical kinetics. , 2014, The Journal of chemical physics.

[14]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[15]  Ramon Grima,et al.  A study of the accuracy of moment-closure approximations for stochastic chemical kinetics. , 2012, The Journal of chemical physics.

[16]  Benny Van Houdt,et al.  A Fair Comparison of Pull and Push Strategies in Large Distributed Networks , 2014, IEEE/ACM Transactions on Networking.

[17]  Lei Ying.  Stein's Method for Mean-Field Approximations in Light and Heavy Traffic Regimes , 2017, SIGMETRICS.

[18]  H. Andersson,et al.  Stochastic Epidemic Models and Their Statistical Analysis , 2000 .

[19]  Luca Bortolussi,et al.  Size expansions of mean field approximation: Transient and steady-state analysis , 2019, Perform. Evaluation.

[20]  Luca Bortolussi,et al.  Bounds on the deviation of discrete-time Markov chains from their mean-field model , 2013, Perform. Evaluation.

[21]  Benny Van Houdt,et al.  A Refined Mean Field Approximation , 2017, Proc. ACM Meas. Anal. Comput. Syst..

[22]  C. Stein.  Approximate computation of expectations , 1986 .

[23]  Linzhang Lu,et al.  A projection method and Kronecker product preconditioner for solving Sylvester tensor equations , 2012, Science China Mathematics.

[24]  John N. Tsitsiklis,et al.  On the power of (even a little) centralization in distributed processing , 2011, SIGMETRICS '11.

[25]  Philipp Thomas,et al.  How accurate are the nonlinear chemical Fokker-Planck and chemical Langevin equations? , 2011, The Journal of chemical physics.

[26]  Benny Van Houdt,et al.  Transient and steady-state regime of a family of list-based cache replacement algorithms , 2016, Queueing Syst. Theory Appl..

[27]  Jean-Yves Le Boudec,et al.  The age of gossip: spatial mean field regime , 2009, SIGMETRICS '09.

[28]  Guido Sanguinetti,et al.  Comparison of different moment-closure approximations for stochastic chemical kinetics. , 2015, The Journal of chemical physics.

[29]  Bruno Gaujal,et al.  A mean field model of work stealing in large-scale systems , 2010, SIGMETRICS '10.

[30]  Fabian J. Theis,et al.  CERENA: ChEmical REaction Network Analyzer—A Toolbox for the Simulation and Analysis of Stochastic Chemical Kinetics , 2016, PloS one.

[31]  R. Grima,et al.  Intrinsic Noise Analyzer: A Software Package for the Exploration of Stochastic Biochemical Kinetics Using the System Size Expansion , 2012, PloS one.

[32]  Lei Ying,et al.  On the Approximation Error of Mean-Field Models , 2016, SIGMETRICS.

[33]  T. Kurtz.  Strong approximation theorems for density dependent Markov chains , 1978 .

[34]  Michael Mitzenmacher.  Analyzing distributed Join-Idle-Queue: A fluid limit approach , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[35]  T. Kurtz.  Solutions of ordinary differential equations as limits of pure jump markov processes , 1970, Journal of Applied Probability.

[36]  Laurent Massoulié,et al.  Coupon replication systems , 2005, IEEE/ACM Transactions on Networking.

[37]  J. Dai,et al.  Stein's method for steady-state diffusion approximations of $M/Ph/n+M$ systems , 2015 .

[38]  Bruno Gaujal,et al.  Markov chains with discontinuous drifts have differential inclusions limits , 2012 .

[39]  Yuming Jiang,et al.  On the Asymptotic Validity of the Decoupling Assumption for Analyzing 802.11 MAC Protocol , 2011, IEEE Transactions on Information Theory.

[40]  R. Srikant,et al.  Power of d Choices for Large-Scale Bin Packing , 2015, SIGMETRICS.

[41]  James D. Murray.  Mathematical Biology: I. An Introduction , 2007 .

[42]  Sem C. Borst,et al.  Mean-Field Analysis of Ultra-Dense CSMA Networks , 2015, PERV.

[43]  R. Grima,et al.  An effective rate equation approach to reaction kinetics in small volumes: theory and application to biochemical reactions in nonequilibrium steady-state conditions. , 2010, The Journal of chemical physics.