Hidden Markov models with arbitrary state dwell-time distributions

A hidden Markov model (HMM) with a special structure that captures the 'semi'-property of hidden semi-Markov models (HSMMs) is considered. The proposed model allows arbitrary dwell-time distributions in the states of the Markov chain. For dwell-time distributions with finite support the HMM formulation is exact while for those that have infinite support, e.g. the Poisson, the distribution can be approximated with arbitrary accuracy. A benefit of using the HMM formulation is that it is easy to incorporate covariates, trend and seasonal variation particularly in the hidden component of the model. In addition, the formulae and methods for forecasting, state prediction, decoding and model checking that exist for ordinary HMMs are applicable to the proposed class of models. An HMM with explicitly modeled dwell-time distributions involving seasonality is used to model daily rainfall occurrence for sites in Bulgaria.

[1]  Y. Guédon Estimating Hidden Semi-Markov Chains From Discrete Sequences , 2003 .

[2]  W. Zucchini,et al.  Hidden Markov Models for Time Series: An Introduction Using R , 2009 .

[3]  J. Sansom,et al.  On rainfall seasonality using a hidden semi‐Markov model , 2007 .

[4]  Ross Ihaka,et al.  Gentleman R: R: A language for data analysis and graphics , 1996 .

[5]  A. Cook,et al.  Experimental evaluation of duration modelling techniques for automatic speech recognition , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Lain L. MacDonald,et al.  Hidden Markov and Other Models for Discrete- valued Time Series , 1997 .

[7]  Catherine Trottier,et al.  Markov and Semi‐Markov Switching Linear Mixed Models Used to Identify Forest Tree Growth Components , 2010, Biometrics.

[8]  T. McMahon,et al.  Stochastic generation of annual, monthly and daily climate data: A review , 2001 .

[9]  H. Kobayashi,et al.  An efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2003, IEEE Signal Processing Letters.

[10]  J. Sansom,et al.  Fitting hidden semi-Markov models to breakpoint rainfall data , 2001, Journal of Applied Probability.

[11]  Jan Bulla,et al.  hsmm - An R package for analyzing hidden semi-Markov models , 2010, Comput. Stat. Data Anal..

[12]  V. Kulkarni Modeling and Analysis of Stochastic Systems , 1996 .

[13]  Francesco Bartolucci,et al.  Latent Markov model for longitudinal binary data: An application to the performance evaluation of nursing homes , 2009, 0908.2300.

[14]  J. Griffiths The Theory of Stochastic Processes , 1967 .

[15]  Neri Merhav,et al.  Hidden Markov processes , 2002, IEEE Trans. Inf. Theory.

[16]  R. Altman Mixed Hidden Markov Models , 2007 .

[17]  J. Ben Atkinson,et al.  Modeling and Analysis of Stochastic Systems , 1996 .

[18]  Leonard Kleinrock,et al.  Queueing Systems - Vol. 1: Theory , 1975 .

[19]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[20]  Yann Guédon,et al.  Hidden hybrid Markov/semi-Markov chains , 2005, Comput. Stat. Data Anal..

[21]  E. L. Russell Statistics in the Environmental & Earth Sciences , 1992 .

[22]  M. T. Johnson,et al.  Capacity and complexity of HMM duration modeling techniques , 2005, IEEE Signal Processing Letters.