Comparison Results for Markov-Modulated Recursive Models

We consider a general discrete-time stochastic recursive model that is influenced by an external Markov chain. Our aim is to investigate the effect that the transition matrix of the external process has on the system states of the model. To answer this question, we use new stochastic ordering concepts. Especially interesting are the results for infinite-stage Markov-modulated models. We illustrate our main results by three applications: an inventory model, a consumption model, and a queueing model for a time division multiplexing system.

[1]  N. L. Lawrie,et al.  Comparison Methods for Queues and Other Stochastic Models , 1984 .

[2]  A. Tchen Inequalities for distributions with given marginals , 1976 .

[3]  J. George Shanthikumar,et al.  Regularity of Stochastic Processes: A Theory Based on Directional Convexity , 1993 .

[4]  Moshe Sidi,et al.  Discrete-time priority queues with two-state markov modulated arrivals , 1992 .

[5]  Sheldon M. Ross,et al.  Stochastic Processes , 1982, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[6]  R. Szekli Stochastic Ordering and Dependence in Applied Probability , 1995 .

[7]  S. Asmussen Risk theory in a Markovian environment , 1989 .

[8]  Michael Pinedo,et al.  Monotonicity results for queues with doubly stochastic Poisson arrivals: Ross's conjecture , 1991, Advances in Applied Probability.

[9]  San-qi Li,et al.  Performance Trade-Offs in an Integrated Voice/Data Services TDM System , 1988, Perform. Evaluation.

[10]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[11]  Michael Pinedo,et al.  Integration of Discrete-Time Correlated Markov Processes in a TDM System , 1990 .

[12]  Tomasz Rolski Queues with nonstationary inputs , 1989, Queueing Syst. Theory Appl..

[13]  Moshe Shaked,et al.  Stochastic orders and their applications , 1994 .

[14]  W. D. Ray Stationary Stochastic Models , 1991 .

[15]  Ryszard Szekli,et al.  MR/GI/1 QUEUES WITH POSITIVELY CORRELATED ARRIVAL STREAM , 1994 .

[16]  Michael Pinedo,et al.  Stochastic convexity for multidimensional processes and its applications , 1991 .

[17]  J. Reinhard,et al.  On a Class of Semi-Markov Risk Models Obtained as Classical Risk Models in a Markovian Environment , 1984, ASTIN Bulletin.

[18]  R. M. Loynes The stability of queues with non-independent interarrival and service times , 1962 .

[19]  Ward Whitt,et al.  Comparison methods for queues and other stochastic models , 1986 .

[20]  Nicole Bäuerle Monotonicity results for MR / GI /1 queues , 1997 .

[21]  P. Franken,et al.  Stationary Stochastic Models. , 1992 .