Fitting hidden semi-Markov models to breakpoint rainfall data

The paper proposes a hidden semi-Markov model for breakpoint rainfall data that consist of both the times at which rain-rate changes and the steady rates between such changes. The model builds on and extends the seminal work of Ferguson (1980) on variable duration models for speech. For the rainfall data the observations are modelled as mixtures of log-normal distributions within unobserved states where the states evolve in time according to a semi-Markov process. For the latter, parametric forms need to be specified for the state transition probabilities and dwell-time distributions. Recursions for constructing the likelihood are developed and the EM algorithm used to fit the parameters of the model. The choice of dwell-time distribution is discussed with a mixture of distributions over disjoint domains providing a flexible alternative. The methods are also extended to deal with censored data. An application of the model to a large-scale bivariate dataset of breakpoint rainfall measurements at Wellington, New Zealand, is discussed.

[1]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[2]  Ronald Biondini.  Cloud Motion and Rainfall Statistics , 1976 .

[3]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[4]  L. R. Koenig,et al.  A Short Course in Cloud Physics , 1979 .

[5]  L. R. Rabiner,et al.  An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition , 1983, The Bell System Technical Journal.

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  I. Meilijson.  A fast improvement to the EM algorithm on its own terms , 1989 .

[8]  Yann Guédon,et al.  Explicit state occupancy modelling by hidden semi-Markov models: application of Derin's scheme , 1990 .

[9]  Peter Guttorp,et al.  A Hidden Markov Model for Space‐Time Precipitation , 1991 .

[10]  Peter Thomson,et al.  Rainfall Classification Using Breakpoint Pluviograph Data , 1992 .

[11]  David A. Short,et al.  A Probability Distribution Model for Rain Rate , 1994 .

[12]  John Sansom.  Rainfall Discrimination and Spatial Variation Using Breakpoint Data , 1995 .

[13]  S. Eddy.  Hidden Markov models. , 1996, Current opinion in structural biology.

[14]  James P. Hughes,et al.  Computing the observed information in the hidden Markov model using the EM algorithm , 1997 .

[15]  Detecting components in censored and truncated meteorological data , 1998 .

[16]  S. P. Pederson,et al.  Hidden Markov and Other Models for Discrete-Valued Time Series , 1998 .

[17]  J. Sansom,et al.  A Hidden Markov Model for Rainfall Using Breakpoint Data , 1998 .

[18]  Large‐scale spatial variability of rainfall through hidden semi‐Markov models of breakpoint data , 1999 .

[19]  P. Guttorp,et al.  A non‐homogeneous hidden Markov model for precipitation occurrence , 1999 .