Recursive estimation of parameters in Markov-modulated Poisson processes

A hidden Markov regime is a Markov process that governs the time or space dependent distributions of an observed stochastic process. Recursive algorithms can be used to estimate parameters in mixed distributions governed by a Markov regime. The authors derive a recursive algorithm for estimation of parameters in a Markov-modulated Poisson process also called a Cox point process. By this the authors mean a doubly stochastic Poisson process with a time dependent intensity that can take on a finite number of different values. The intensity switches randomly between the possible values according to a Markov process. The authors consider two different ways to observe the Markov-modulated Poisson process: in the first model the observations consist of the observed time intervals between events, and in the second model they use the total number of events in successive intervals of fixed length. They derive an algorithm for recursive estimation of the Poisson intensities and the switch intensities between the two states and illustrate the algorithm in a simulation study. The estimates of the switch intensities are based on the observed conditional switch probabilities.

[1]  Georg Lindgren,et al.  Recursive estimation in mixture models with Markov regime , 1991, IEEE Trans. Inf. Theory.

[2]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[3]  Mats Rudemo,et al.  DOUBLY STOCHASTIC POISSON PROCESSES , 1972 .

[4]  D. Titterington.  Some recent research in the analysis of mixture distributions , 1990 .

[5]  B. Leroux.  Maximum-likelihood estimation for hidden Markov models , 1992 .

[6]  U. Holst,et al.  Recursive estimation in switching autoregressions with Markov regime , 1994 .

[7]  Wolfgang Fischer,et al.  The Markov-Modulated Poisson Process (MMPP) Cookbook , 1993, Perform. Evaluation.

[8]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[9]  M. Rudemo.  Doubly stochastic Poisson processes and process control , 1972, Advances in Applied Probability.

[10]  T. Rydén.  Parameter Estimation for Markov Modulated Poisson Processes , 1994 .

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  T. Riden,et al.  Consistent and Asymptotically Normal Parameter Estimates for Markov Modulated Poisson Processes , 1995 .

[13]  K. Meier-Hellstern.  A fitting algorithm for Markov-modulated poisson processes having two arrival rates , 1987 .

[14]  T. Rydén.  An EM algorithm for estimation in Markov-modulated Poisson processes , 1996 .

[15]  V. Fabian.  On Asymptotically Efficient Recursive Estimation , 1978 .

[16]  Neri Merhav,et al.  Universal classification for hidden Markov models , 1991, IEEE Trans. Inf. Theory.

[17]  Donald L. Snyder,et al.  Random Point Processes in Time and Space , 1991 .

[18]  G. Lindgren.  Markov regime models for mixed distributions and switching regressions , 1978 .