Exact filtering for partially observed continuous time models

Summary.  The forward–backward algorithm is an exact filtering algorithm which can efficiently calculate likelihoods, and which can be used to simulate from posterior distributions. Using a simple result which relates gamma random variables with different rates, we show how the forward–backward algorithm can be used to calculate the distribution of a sum of gamma random variables, and to simulate from their joint distribution given their sum. One application is to calculating the density of the time of a specific event in a Markov process, as this time is the sum of exponentially distributed interevent times. This enables us to apply the forward–backward algorithm to a range of new problems. We demonstrate our method on three problems: calculating likelihoods and simulating allele frequencies under a non‐neutral population genetic model, analysing a stochastic epidemic model and simulating speciation times in phylogenetics.

[1]  B. Rannala,et al.  Probability distribution of molecular evolutionary trees: A new method of phylogenetic inference , 1996, Journal of Molecular Evolution.

[2]  H. Kishino,et al.  Dating of the human-ape splitting by a molecular clock of mitochondrial DNA , 2005, Journal of Molecular Evolution.

[3]  J. Felsenstein Evolutionary trees from DNA sequences: A maximum likelihood approach , 2005, Journal of Molecular Evolution.

[4]  John P. Huelsenbeck,et al.  Application of the Likelihood Function in Phylogenetic Analysis , 2004 .

[5]  Michael D. Hendy,et al.  Phylogenetics: Parsimony and Distance Methods , 2004 .

[6]  Christian P. Robert,et al.  Linking theory and practice of MCMC. , 2003 .

[7]  S. L. Scott Bayesian Methods for Hidden Markov Models , 2002 .

[8]  P Joyce,et al.  Likelihoods and simulation methods for a class of nonneutral population genetics models. , 2001, Genetics.

[9]  Michael P. Wiper,et al.  Mixtures of Gamma Distributions With Applications , 2001 .

[10]  P. Fearnhead Perfect simulation from population genetic models with selection. , 2001, Theoretical population biology.

[11]  Darren J. Wilkinson,et al.  Detecting homogeneous segments in DNA sequences by using hidden Markov models , 2000 .

[12]  Justin K. Romberg,et al.  Bayesian tree-structured image modeling using wavelet-domain hidden Markov models , 1999, Optics & Photonics.

[13]  Jun S. Liu,et al.  Markovian structures in biological sequence alignments , 1999 .

[14]  G. Roberts,et al.  Bayesian inference for partially observed stochastic epidemics , 1999 .

[15]  David J. Spiegelhalter,et al.  Probabilistic Networks and Expert Systems , 1999, Information Science and Statistics.

[16]  S. P. Pederson,et al.  Hidden Markov and Other Models for Discrete-Valued Time Series , 1998 .

[17]  P. Yip,et al.  Statistical inference for a multitype epidemic model , 1998 .

[18]  B. Rannala,et al.  Bayesian phylogenetic inference using DNA sequences: a Markov Chain Monte Carlo Method. , 1997, Molecular biology and evolution.

[19]  M. Pitt,et al.  Analytic Convergence Rates and Parameterization Issues for the Gibbs Sampler Applied to State Space Models , 1999 .

[20]  T. Rydén An EM algorithm for estimation in Markov-modulated Poisson processes , 1996 .

[21]  P. Joyce Robustness of the Ewens sampling formula , 1995, Journal of Applied Probability.

[22]  S. Chib,et al.  Bayes inference via Gibbs sampling of autoregressive time series subject to Markov mean and variance shifts , 1993 .

[23]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[24]  T Gojobori,et al.  Molecular phylogeny and evolution of primate mitochondrial DNA. , 1988, Molecular biology and evolution.

[25]  A. M. Mathai Storage capacity of a dam with gamma type inputs , 1982 .

[26]  N. Ling The Mathematical Theory of Infectious Diseases and its applications , 1978 .

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  J. Radcliffe,et al.  The Mathematical Theory of Infectious Diseases and its Applications , 1977 .

[29]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .