On occurrence of patterns in Markov chains: Method of gambling teams

A new martingale technique is developed to find formulas for the first two moments and generating function of the waiting time until one observes an element of a finite collection of patterns in a finite multi-state Markov chain.

[1]  Valeri T. Stefanov.  The Intersite Distances between Pattern Occurrences in Strings Generated by General Discrete- and Continuous-Time - Models : An Algorithmic Approach , 2003 .

[2]  PATTERNS IN A SEQUENCE OF MULTISTATE TRIALS , 2002 .

[3]  J. Fu,et al.  Distribution of the scan statistic for a sequence of bistate trials , 2001, Journal of Applied Probability.

[4]  Małgorzata Roos,et al.  Runs and Scans With Applications , 2001 .

[5]  Yung-Ming Chang.  Distribution of waiting time until the rth occurrence of a compound pattern , 2005 .

[6]  J. Steele,et al.  A martingale approach to scan statistics , 2005 .

[7]  S. Aki,et al.  Number of occurrences of subpattern until the first appearance of a pattern and geometric distribution , 2003 .

[8]  W. Y. Wendy Lou,et al.  Waiting Time Distributions of Simple and Compound Patterns in a Sequence of r-th Order Markov Dependent Multi-state Trials , 2006 .

[9]  Gambling teams and waiting times for patterns in two-state Markov chains , 2006 .

[10]  Valeri T. Stefanov.  On some waiting time problems , 2000, Journal of Applied Probability.

[11]  Michael R. Chernick,et al.  Runs and Scans With Applications , 2002, Technometrics.

[12]  Hans U. Gerber,et al.  The occurrence of sequence patterns in repeated experiments and hitting times in a Markov chain , 1981 .

[13]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[14]  David Williams,et al.  Probability with Martingales: Martingales , 1991 .

[15]  Demetrios L. Antzoulakos,et al.  Waiting times for patterns in a sequence of multistate trials , 2001, Journal of Applied Probability.

[16]  A. Rukhin.  Distribution of the number of words with a prescribed frequency and tests of randomness , 2002, Advances in Applied Probability.