A multi-dimensional martingale for Markov additive processes and its applications

We establish new multidimensional martingales for Markov additive processes and certain modifications of such processes (e.g., such processes with reflecting barriers). These results generalize corresponding one-dimensional martingale results for Lévy processes. This martingale is then applied to various storage processes, queues and Brownian motion models.

[1]  S. Asmussen.  BUSY PERIOD ANALYSIS, RARE EVENTS AND TRANSIENT BEHAVIOR IN FLUID FLOW MODELS , 1994 .

[2]  L. Rogers.  Fluid Models in Queueing Theory and Wiener-Hopf Factorization of Markov Chains , 1994 .

[3]  J. Neveu.  Une Generalisation des Processus à Accroissements Positifs Independants , 1961 .

[4]  M. Neuts.  A Versatile Markovian Point Process , 1979 .

[5]  J. Harrison,et al.  Brownian motion and stochastic flow systems , 1986 .

[6]  S. Asmussen.  Stationary distributions for fluid flow models with or without Brownian noise , 1995 .

[7]  S. Asmussen.  Risk theory in a Markovian environment , 1989 .

[8]  E. Çinlar.  Markov additive processes. II , 1972 .

[9]  P. Protter.  Stochastic integration and differential equations , 1990 .

[10]  David Perry,et al.  On cycle maxima, first passage problems and extreme value theory for queues , 1992 .

[11]  G. J. K. Regterschot,et al.  The Queue M|G|1 with Markov Modulated Arrivals and Services , 1986, Math. Oper. Res..

[12]  Armand M. Makowski,et al.  Martingale relations for the M⧸GI⧸1 queue with Markov modulated Poisson input , 1991 .

[13]  Søren Asmussen,et al.  Ladder heights and the Markov-modulated M/G/1 queue☆ , 1991 .

[14]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[15]  Gennady Samorodnitsky,et al.  Heavy Tails and Long Range Dependence in On/Off Processes and Associated Fluid Models , 1998, Math. Oper. Res..

[16]  Søren Asmussen,et al.  An Operational Calculus for Matrix-Exponential Distributions, with Applications to a Brownian (q, Q) Inventory Model , 1998, Math. Oper. Res..

[17]  Haya Kaspi,et al.  Storage Processes with Markov Additive Input and Output , 1984, Math. Oper. Res..

[18]  Aleksandr Alekseevich Borovkov,et al.  Stochastic processes in queueing theory , 1976 .

[19]  D. Mitra,et al.  Stochastic theory of a data-handling system with multiple sources , 1982, The Bell System Technical Journal.

[20]  S. Asmussen.  Extreme Value Theory for Queues Via Cycle Maxima , 1998 .

[21]  W. Whitt,et al.  Stability and structural properties of stochastic storage networks , 1996, Journal of Applied Probability.