Large deviations for Markov chains in the positive quadrant

The paper deals with so-called -partially space-homogeneous time-homogeneous Markov chains , , , in the positive quadrant . These Markov chains are characterized by the following property of the transition probabilities : for some the measure depends only on , , and in the domain N$ SRC=http://ej.iop.org/images/0036-0279/56/5/R01/tex_rm_398_img12.gif/>, N$ SRC=http://ej.iop.org/images/0036-0279/56/5/R01/tex_rm_398_img13.gif/>, and only on , , and in the domain N$ SRC=http://ej.iop.org/images/0036-0279/56/5/R01/tex_rm_398_img17.gif/>, N$ SRC=http://ej.iop.org/images/0036-0279/56/5/R01/tex_rm_398_img18.gif/>. For such chains the asymptotic behaviour of is found for a fixed set as , , and . Some other conditions on the growth of parameters are also considered, for example, , . A study is made of the structure of the most probable trajectories, which give the main contribution to this asymptotics, and a number of other results pertaining to the topic are established. Similar results are obtained for the narrower class of 0-partially homogeneous ergodic chains under less restrictive moment conditions on the transition probabilities . Moreover, exact asymptotic expressions for the probabilities are found for 0-partially homogeneous ergodic chains under some additional conditions. The interest in partially homogeneous Markov chains in positive octants is due to the mathematical aspects (new and interesting problems arise in the framework of general large deviation theory) as well as applied issues, for such chains prove to be quite accurate mathematical models for numerous basic types of queueing and communication networks such as the widely known Jackson networks, polling systems, or communication networks associated with the ALOHA algorithm. There is a vast literature dealing with the analysis of these objects. The present paper is an attempt to find the extent to which an asymptotic analysis is possible for Markov chains of this type in their general form without using any special properties of the specific applications mentioned above. It turns out that such an analysis is quite possible, though difficult, in the two-dimensional case. However, even in the three-dimensional case one encounters new fundamental difficulties which, at the present state of the art, render the problem insoluble or at least extremely hard to solve.

[1]  A. Borovkov.  Boundary-Value Problems for Random Walks and Large Deviations in Function Spaces , 1967 .

[2]  Venkat Anantharam,et al.  Stationary tail probabilities in exponential server tandems with renewal arrivals , 1996, Queueing Syst. Theory Appl..

[3]  R. L. Dobrushin,et al.  LARGE DEVIATIONS FOR RANDOM PROCESSES WITH INDEPENDENT INCREMENTS ON INFINITE INTERVALS , 1998 .

[4]  On the limit conditional distributions connected with large deviations , 1996 .

[5]  P. Dupuis,et al.  The large deviation principle for a general class of queueing systems. I , 1995 .

[6]  A. D. Venttsel.  Rough Limit Theorems on Large Deviations for Markov Stochastic Processes. IV , 1977 .

[7]  R. L. Dobrushin,et al.  Process Level Large Deviations for a Class of Piecewise Homogeneous Random Walks , 1994 .

[8]  P. Dupuis,et al.  Large deviations for Markov processes with discontinuous statistics, II: random walks , 1992 .

[9]  G. Fayolle,et al.  Topics in the Constructive Theory of Countable Markov Chains: Ideology of induced chains , 1995 .

[10]  A. A. Borovkov,et al.  Integro-Local Limit Theorems Including Large Deviations for Sums of Random Vectors. II , 1999 .

[11]  E. Nummelin.  General irreducible Markov chains and non-negative operators: Notes and comments , 1984 .

[12]  Michel Mandjes,et al.  Large Deviations for Performance Analysis: Queues, Communications, and Computing , Adam Shwartz and Alan Weiss (New York: Chapman and Hall, 1995). , 1996, Probability in the Engineering and Informational Sciences.

[13]  J. Lynch,et al.  A weak convergence approach to the theory of large deviations , 1997 .

[14]  A. Borovkov.  On the Cramér transform, large deviations in boundary value problems, and the conditional invariance principle , 1995 .

[15]  Vadim Malyshev,et al.  Boundary effects in large deviation problems , 1994 .

[16]  R. Dobrushin,et al.  Large deviations for tandem queueing systems , 1994 .

[17]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[18]  John N. Tsitsiklis,et al.  Large deviations analysis of the generalized processor sharing policy , 1999, Queueing Syst. Theory Appl..

[19]  Интегро-локальные предельные теоремы для сумм случайных векторов, включающие большие уклонения. II@@@Integro-local limit theorems including large deviations for sums of random vectors. II , 1998 .

[20]  Neil O'Connell.  Large deviations for departures from a shared buffer , 1997 .

[21]  Srinivasa R. S. Varadhan,et al.  Asymptotic probabilities and differential equations , 1966 .

[22]  Anatolii A. Puhalskii,et al.  Moderate deviations for queues in critical loading , 1999, Queueing Syst. Theory Appl..

[23]  CONVERGENCE OF MEASURES AND RANDOM PROCESSES , 1976 .

[24]  A. A. Mogul'skii.  Large Deviations for Trajectories of Multi-Dimensional Random Walks , 1977 .

[25]  A. Skorokhod.  Limit Theorems for Stochastic Processes , 1956 .

[26]  Kurt Majewski.  Large deviations of the steady-state distribution of reflected processes with applications to queueing systems , 1998, Queueing Syst. Theory Appl..

[27]  Вероятности больших уклонений одномерных цепей Маркова. Часть 1. Стационарные распределения@@@Large-deviation probabilities for one-dimensional Markov chains. Part 1: Stationary distributions , 1996 .

[28]  Kurt Majewski.  Heavy traffic approximations of large deviations of feedforward queueing networks , 1998, Queueing Syst. Theory Appl..

[29]  A. A. Borovkov,et al.  The second rate function and the asymptotic problems of renewal and hitting the boundary for multidimensional random walks , 1996 .

[30]  Irina Ignatiouk-Robert,et al.  Large deviations of Jackson networks , 2000 .

[31]  Dmitry Korshunov,et al.  Large-Deviation Probabilities for One-Dimensional Markov ChainsPart 1: Stationary Distributions , 1997 .

[32]  Tim Zajic.  Rough asymptotics for tandem non-homogeneous $$M/G/\infty$$ queues via Poissonized empirical processes , 1998, Queueing Syst. Theory Appl..

[33]  P. Dupuis,et al.  A VISCOSITY SOLUTION APPROACH TO THE ASYMPTOTIC ANALYSIS OF QUEUEING SYSTEMS , 1990 .