Waiting Time Problems for Patterns in a Sequence of Multi-State Trials

In this paper, we investigate waiting time problems for a finite collection of patterns in a sequence of independent multi-state trials. By constructing a finite GI/M/1-type Markov chain with a disaster and then using the matrix analytic method, we can obtain the probability generating function of the waiting time. From this, we can obtain the stopping probabilities and the mean waiting time, but it also enables us to compute the waiting time distribution by a numerical inversion.

[1]  Hans U. Gerber,et al.  The occurrence of sequence patterns in repeated experiments and hitting times in a Markov chain , 1981 .

[2]  Leonidas J. Guibas,et al.  String Overlaps, Pattern Matching, and Nontransitive Games , 1981, J. Comb. Theory A.

[3]  G. Blom,et al.  How many random digits are required until given sequences are obtained? , 1982, Journal of Applied Probability.

[4]  Gambling teams and waiting times for patterns in two-state Markov chains , 2006 .

[5]  James C. Fu,et al.  Reliability of Consecutive-k-out-of-n:F Systems with (k-1)-step Markov Dependence , 1986, IEEE Transactions on Reliability.

[6]  Demetrios L. Antzoulakos,et al.  Waiting times for patterns in a sequence of multistate trials , 2001, Journal of Applied Probability.

[7]  Vladimir Pozdnyakov.  On occurrence of patterns in Markov chains: Method of gambling teams , 2008 .

[8]  Ward Whitt,et al.  Numerical inversion of probability generating functions , 1992, Oper. Res. Lett..

[9]  Markos V. Koutras,et al.  Distribution Theory of Runs: A Markov Chain Approach , 1994 .

[10]  Stopping Probabilities for Patterns in Markov Chains , 2014, Journal of Applied Probability.

[11]  S. Li,et al.  A Martingale Approach to the Study of Occurrence of Sequence Patterns in Repeated Experiments , 1980 .

[12]  James C. Fu,et al.  On probability generating functions for waiting time distributions of compound patterns in a sequence of multistate trials , 2002, Journal of Applied Probability.

[13]  Waiting times and stopping probabilities for patterns in Markov chains , 2016, 1602.06512.

[14]  Jeongsim Kim,et al.  Sooner waiting time problems in a sequence of multi-state trials with random rewards , 2019, Statistics & Probability Letters.

[15]  Katuomi Hirano,et al.  Sooner and later waiting time problems for patterns in Markov dependent trials , 2003, Journal of Applied Probability.

[16]  Yung-Ming Chang.  Distribution of waiting time until the rth occurrence of a compound pattern , 2005 .