The variance constant for continuous-time level dependent quasi-birth-and-death processes

ABSTRACT We derive the variance constant of continuous-time level dependent quasi-birth-and-death processes by investigating the expected integral functionals of the first return times. As an application, we consider the variance constant for the M/M/c retrial queue with non-persistent customers. For this model, analytical expressions and numerical results are obtained for the cases of single server and multiple servers, respectively. We also apply the obtained result to test the M/M/c vacation model for airport security pre-board screening checkpoint services by constructing a confidence interval for the mean queue length.

[1]  Vaidyanathan Ramaswami,et al.  A logarithmic reduction algorithm for quasi-birth-death processes , 1993, Journal of Applied Probability.

[2]  Peter G. Taylor,et al.  Calculating the equilibrium distribution in level dependent quasi-birth-and-death processes , 1995 .

[3]  Xiuli Chao,et al.  Analysis of multi-server queues with station and server vacations , 1998, Eur. J. Oper. Res..

[4]  W. J. Anderson.  Continuous-Time Markov Chains: An Applications-Oriented Approach , 1991 .

[5]  P. Glynn,et al.  Necessary conditions in limit theorems for cumulative processes , 2002 .

[6]  Marcel F. Neuts,et al.  Matrix-geometric solutions in stochastic models - an algorithmic approach , 1982 .

[7]  Ward Whitt,et al.  Asymptotic Formulas for Markov Processes with Applications to Simulation , 1992, Oper. Res..

[8]  Yutaka Takahashi,et al.  A simple algorithm for the rate matrices of level-dependent QBD processes , 2010, QTNA.

[9]  Yuanyuan Liu.  Additive Functionals for Discrete-Time Markov Chains with Applications to Birth-Death Processes , 2011, Journal of Applied Probability.

[10]  Yuanyuan Liu,et al.  Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes , 2015 .

[11]  Ward Whitt,et al.  Chapter 13 Analysis for Design , 2006, Simulation.

[12]  P. Glynn.  Poisson's equation for the recurrent M/G/1 queue , 1994, Advances in Applied Probability.

[13]  Hendrik Baumann,et al.  Computing Stationary Expectations in Level-Dependent QBD Processes , 2013, J. Appl. Probab..

[14]  Covariance Ordering for discrete and continuous time Markov Chains , 2009 .

[15]  Mogens Bladt,et al.  Poisson's equation for queues driven by a Markovian marked point process , 1994, Queueing Syst. Theory Appl..

[16]  Nigel G. Bean,et al.  Markovian trees: properties and algorithms , 2008, Ann. Oper. Res..

[17]  Bin Liu,et al.  Tail asymptotics for M/M/c retrial queues with non-persistent customers , 2012, Oper. Res..

[18]  Yuanyuan Liu,et al.  Wavelet transform for quasi-birth-death process with a continuous phase set , 2015, Appl. Math. Comput..

[19]  J. Templeton.  Retrial queues , 1999 .

[20]  Yuanyuan Liu,et al.  Deviation matrix and asymptotic variance for GI/M/1-type Markov chains , 2014 .

[21]  Yuanyuan Liu,et al.  Poisson’s equation for discrete-time single-birth processes , 2014 .

[22]  W. J. Anderson.  Continuous-Time Markov Chains , 1991 .

[23]  P. Taylor,et al.  Some properties of the rate operators in level dependent quasi-birth-and-death processes with a countable number of phases , 1996 .

[24]  Zhenting Hou,et al.  Several types of ergodicity for M/G/1-type Markov chains and Markov processes , 2006 .

[25]  Winfried K. Grassmann,et al.  The asymptotic variance of a time average in a birth-death process , 1987 .

[26]  Pauline Coolen-Schrijner,et al.  THE DEVIATION MATRIX OF A CONTINUOUS-TIME MARKOV CHAIN , 2002, Probability in the Engineering and Informational Sciences.

[27]  Yoni Nazarathy,et al.  The asymptotic variance of departures in critically loaded queues , 2010, Advances in Applied Probability.

[28]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[29]  Yuanyuan Liu,et al.  Poisson's equation for discrete-time quasi-birth-and-death processes , 2013, Perform. Evaluation.

[30]  Hendrik Baumann,et al.  On the numerical solution of Kronecker-based infinite level-dependent QBD processes , 2013, Perform. Evaluation.

[31]  J. Meyer.  The Role of the Group Generalized Inverse in the Theory of Finite Markov Chains , 1975 .

[32]  Yutaka Takahashi,et al.  A matrix continued fraction approach to multiserver retrial queues , 2013, Ann. Oper. Res..

[33]  M. Bladt.  The variance constant for the actual waiting time of the $PH/PH/1$ queue , 1996 .

[34]  Florin Avram,et al.  On Multiserver retrial Queues: History, Okubo-Type hypergeometric Systems and Matrix Continued-fractions , 2014, Asia Pac. J. Oper. Res..

[35]  Andrew Watts,et al.  Analysis for design , 2013, Modern Construction Handbook.

[36]  Samuel Karlin,et al.  The classification of birth and death processes , 1957 .

[37]  A Structured Markov Chain Approach to Branching Processes , 2015 .

[38]  Mu-Fa Chen,et al.  From Markov Chains to Non-Equilibrium Particle Systems , 1992 .