Comparison Results for Markov-Modulated Recursive Models

We consider a general discrete-time stochastic recursive model that is influenced by an external Markov chain. Our aim is to investigate the effect that the transition matrix of the external process has on the system states of the model. To answer this question, we use new stochastic ordering concepts. Especially interesting are the results for infinite-stage Markov-modulated models. We illustrate our main results by three applications: an inventory model, a consumption model, and a queueing model for a time division multiplexing system.

[1]  N. L. Lawrie,et al.  Comparison Methods for Queues and Other Stochastic Models , 1984 .

[2]  A. Tchen.  Inequalities for distributions with given marginals , 1976 .

[3]  J. George Shanthikumar,et al.  Regularity of Stochastic Processes: A Theory Based on Directional Convexity , 1993 .

[4]  Moshe Sidi,et al.  Discrete-time priority queues with two-state markov modulated arrivals , 1992 .

[5]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[6]  R. Szekli.  Stochastic Ordering and Dependence in Applied Probability , 1995 .

[7]  S. Asmussen.  Risk theory in a Markovian environment , 1989 .

[8]  Michael Pinedo,et al.  Monotonicity results for queues with doubly stochastic Poisson arrivals: Ross's conjecture , 1991, Advances in Applied Probability.

[9]  San-qi Li,et al.  Performance Trade-Offs in an Integrated Voice/Data Services TDM System , 1988, Perform. Evaluation.

[10]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[11]  Michael Pinedo,et al.  Integration of Discrete-Time Correlated Markov Processes in a TDM System , 1990, Probability in the Engineering and Informational Sciences.

[12]  Tomasz Rolski,et al.  Queues with nonstationary inputs , 1989, Queueing Syst. Theory Appl..

[13]  Moshe Shaked,et al.  Stochastic orders and their applications , 1994 .

[14]  W. D. Ray.  Stationary Stochastic Models , 1991 .

[15]  Ryszard Szekli,et al.  MR/GI/1 queues by positively correlated arrival stream , 1994, Journal of Applied Probability.

[16]  Michael Pinedo,et al.  Stochastic convexity for multidimensional processes and its applications , 1991 .

[17]  J. Reinhard,et al.  On a Class of Semi-Markov Risk Models Obtained as Classical Risk Models in a Markovian Environment , 1984, ASTIN Bulletin.

[18]  R. M. Loynes,et al.  The stability of a queue with non-independent inter-arrival and service times , 1962, Mathematical Proceedings of the Cambridge Philosophical Society.

[19]  Ward Whitt,et al.  Comparison methods for queues and other stochastic models , 1986 .

[20]  Nicole Bäuerle,et al.  Monotonicity results for MR/GI/1 queues , 1997, Journal of Applied Probability.

[21]  P. Franken,et al.  Stationary Stochastic Models. , 1992 .