Efficient Bayesian analysis of multiple changepoint models with dependence across segments

We consider Bayesian analysis of a class of multiple changepoint models. While there are a variety of efficient ways to analyse these models if the parameters associated with each segment are independent, there are few general approaches for models where the parameters are dependent. Under the assumption that the dependence is Markov, we propose an efficient online algorithm for sampling from an approximation to the posterior distribution of the number and position of the changepoints. In a simulation study, we show that the approximation introduced is negligible. We illustrate the power of our approach through fitting piecewise polynomial models to data, under a model which allows for either continuity or discontinuity of the underlying curve at each changepoint. This method is competitive with, or outperform, other methods for inferring curves from noisy data; and uniquely it allows for inference of the locations of discontinuities in the underlying curve.

[1]  G. Nason,et al.  Real nonparametric regression using complex wavelets , 2004 .

[2]  Paul Fearnhead,et al.  Exact and efficient Bayesian inference for multiple changepoint problems , 2006, Stat. Comput..

[3]  H. Rue,et al.  Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations , 2009 .

[4]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[5]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[6]  Jun S. Liu,et al.  Rejection Control and Sequential Importance Sampling , 1998 .

[7]  B. Silverman,et al.  Wavelet thresholding via a Bayesian approach , 1998 .

[8]  R. Kass,et al.  Bayesian curve-fitting with free-knot splines , 2001 .

[9]  P. Fearnhead,et al.  On‐line inference for hidden Markov models via particle filters , 2003 .

[10]  K. Riedel Numerical Bayesian Methods Applied to Signal Processing , 1996 .

[11]  Adrian F. M. Smith,et al.  Automatic Bayesian curve fitting , 1998 .

[12]  Jun S. Liu,et al.  Bayesian inference on biopolymer models , 1999, Bioinform..

[13]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[14]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[15]  John M. Olin Calculating posterior distributions and modal estimates in Markov mixture models , 1996 .

[16]  S. Chib Estimation and comparison of multiple change-point models , 1998 .

[17]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[18]  Stuart Barber,et al.  Posterior probability intervals for wavelet thresholding , 2002 .

[19]  Taha B. M. J. Ouarda,et al.  Recursion‐based multiple changepoint detection in multiple linear regression and application to river streamflows , 2007 .

[20]  J. Hartigan,et al.  Product Partition Models for Change Point Problems , 1992 .

[21]  Christophe Andrieu,et al.  Bayesian curve fitting using MCMC with applications to signal segmentation , 2002, IEEE Trans. Signal Process..

[22]  Marc Lavielle,et al.  An application of MCMC methods for the multiple change-points problem , 2001, Signal Process..

[23]  Paul Fearnhead,et al.  Computational methods for complex stochastic systems: a review of some alternatives to MCMC , 2008, Stat. Comput..

[24]  P. Donnelly,et al.  The Fine-Scale Structure of Recombination Rate Variation in the Human Genome , 2004, Science.

[25]  Paul Fearnhead,et al.  Bayesian Analysis of Isochores , 2009 .

[26]  Paul Fearnhead,et al.  Exact Bayesian curve fitting and signal segmentation , 2005, IEEE Transactions on Signal Processing.

[27]  Yi-Ching Yao Estimation of a Noisy Discrete-Time Step Function: Bayes and Empirical Bayes Approaches , 1984 .

[28]  D. Stephens Bayesian Retrospective Multiple‐Changepoint Identification , 1994 .

[29]  Jitendra Tugnait Detection and estimation for abruptly changing systems , 1981, CDC 1981.

[30]  Jean-Yves Tourneret,et al.  Joint segmentation of wind speed and direction using a hierarchical model , 2007, Comput. Stat. Data Anal..

[31]  P. Fearnhead,et al.  Efficient Online Inference for Multiple Changepoint Problems , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[32]  Zhen Liu,et al.  Direct Simulation Methods for Multiple Changepoint Problems. , 2007 .