The stationary behaviour of fluid limits of reversible processes is concentrated on stationary points

Assume that a stochastic processes can be approximated, when some scale parameter gets large, by a fluid limit (also called “mean field limit”, or “hydrodynamic limit”). A common practice, often called the “fixed point approximation” consists in approximating the stationary behaviour of the stochastic process by the stationary points of the fluid limit. It is known that this may be incorrect in general, as the stationary behaviour of the fluid limit may not be described by its stationary points. We show however that, if the stochastic process is reversible, the fixed point approximation is indeed valid. More precisely, we assume that the stochastic process converges to the fluid limit in distribution (hence in probability) at every fixed point in time. This assumption is very weak and holds for a large family of processes, among which many mean field and other interaction models. We show that the reversibility of the stochastic process implies that any limit point of its stationary distribution is concentrated on stationary points of the fluid limit. If the fluid limit has a unique stationary point, it is an approximation of the stationary distribution of the stochastic process.

[1]  P. J. Hunt,et al.  A Limit Result Respecting Graph Structure for a Fully Connected Loss Network with Alternative Routing , 1991 .

[2]  Jonathan E. Rowe,et al.  El Botellón: Modeling the Movement of Crowds in a City , 2003, Complex Syst..

[3]  Yuming Jiang,et al.  On the validity of the fixed point equation and decoupling assumption for analyzing the 802.11 mac protocol , 2010, PERV.

[4]  T. Kurtz Solutions of ordinary differential equations as limits of pure jump markov processes , 1970, Journal of Applied Probability.

[5]  S. Zachary,et al.  Loss networks , 2009, 0903.0640.

[6]  E. Sercarz,et al.  T cell vaccination in experimental autoimmune encephalomyelitis: a mathematical model. , 1998, Journal of immunology.

[7]  M. Benaïm,et al.  Deterministic Approximation of Stochastic Evolution in Games , 2003 .

[8]  E. Sercarz,et al.  Encephalomyelitis: A Mathematical Model T Cell Vaccination in Experimental Autoimmune , 2013 .

[9]  M. Manhart,et al.  Markov Processes , 2018, Introduction to Stochastic Processes and Simulation.

[10]  G. Bianchi,et al.  IEEE 802.11-saturation throughput analysis , 1998, IEEE Communications Letters.

[11]  Yuming Jiang,et al.  On the Asymptotic Validity of the Decoupling Assumption for Analyzing 802.11 MAC Protocol , 2011, IEEE Transactions on Information Theory.

[12]  M. Bena A Class Of Mean Field Interaction Models for Computer and Communication Systems , 2008 .

[13]  M. Benaïm Dynamics of stochastic approximation algorithms , 1999 .

[14]  Lorenzo Donatiello,et al.  Performance Evaluation of Computer and Communication Systems , 1993, Lecture Notes in Computer Science.

[15]  M. Benaïm,et al.  A class of mean field interaction models for computer and communication systems , 2008, 2008 6th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks and Workshops.

[16]  Jean-Yves Le Boudec,et al.  A class of mean field interaction models for computer and communication systems , 2008, Perform. Evaluation.

[17]  T. Kurtz Approximation of Population Processes , 1987 .

[18]  R. Merz,et al.  Effect on Network Performance of Common versus Private Acquisition Sequences for Impulse Radio UWB Networks , 2006, 2006 IEEE International Conference on Ultra-Wideband.

[19]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[20]  Anthony Unwin,et al.  Reversibility and Stochastic Networks , 1980 .

[21]  D. Aldous Deterministic and stochastic models for coalescence (aggregation and coagulation): a review of the mean-field theory for probabilists , 1999 .

[22]  Richard J. Lorentz Recursive algorithms , 1994, Ablex series in computational science.

[23]  J. Le Boudec Interinput and Interoutput Time Distribution in Classical Product-Form Networks , 1987, IEEE Transactions on Software Engineering.

[24]  Alexandre Proutière,et al.  A particle system in interaction with a rapidly varying environment: Mean field limits and applications , 2010, Networks Heterog. Media.

[25]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[26]  C. Graham,et al.  Propagation of chaos for a fully connected loss network with alternate routing , 1993 .

[27]  Diego Latella,et al.  Modelling Non-linear Crowd Dynamics in Bio-PEPA , 2011, FASE.

[28]  Jean-Yves Le Boudec,et al.  Performance Evaluation of Impulse Radio UWB Networks Using Common or Private Acquisition Preambles , 2009, IEEE Transactions on Mobile Computing.

[29]  Jean-Yves Le Boudec,et al.  A Generic Mean Field Convergence Result for Systems of Interacting Objects , 2007, Fourth International Conference on the Quantitative Evaluation of Systems (QEST 2007).

[30]  M. Benaïm Recursive algorithms, urn processes and chaining number of chain recurrent sets , 1998, Ergodic Theory and Dynamical Systems.

[31]  Eitan Altman,et al.  New Insights From a Fixed-Point Analysis of Single Cell IEEE 802.11 WLANs , 2007, IEEE/ACM Transactions on Networking.

[32]  Mieke Massink,et al.  Revisiting the Limit Behaviour of ``El Botellon" , 2012 .