Bayesian Change Point Analysis of Linear Models on Graphs

Consider observations $y_1,\dots,y_n$ on nodes of a connected graph, where the $y_i$ independently come from $N(\theta_i, \sigma^2)$ distributions and an unknown partition divides the $n$ observations into blocks. One well-studied class of change point problems assumes the means $\theta_i$ are equal for all nodes within contiguous blocks of a simple graph of sequential observations; both frequentist and Bayesian approaches have been used to estimate the $\theta_i$ and the change points of the underlying partition. This paper examines a broad class of change point problems on general connected graphs in which a regression model is assumed to apply within each block of the partition of the graph. This general class also supports multivariate change point problems. We use Bayesian methods to estimate change points or block boundaries of the underlying partition. This paper presents the methodology for the general class of change point problems and develops new algorithms for implementation via Markov Chain Monte Carlo. The paper concludes with simulations and real data examples to demonstrate application of the methodology on a wide range of problems.

[1]  Vito M. R. Muggeo,et al.  Efficient change point detection for genomic sequences of continuous measurements , 2011, Bioinform..

[2]  M. Lavielle,et al.  Detection of multiple change-points in multivariate time series , 2006 .

[3]  V. Muggeo Estimating regression models with unknown break‐points , 2003, Statistics in medicine.

[4]  J. Hartigan,et al.  A Bayesian Analysis for Change Point Problems , 1993 .

[5]  Soyoung Ryu,et al.  Estimating tree resin dose effect on termites , 2006 .

[6]  Idris A. Eckley,et al.  changepoint: An R Package for Changepoint Analysis , 2014 .

[7]  P. Fearnhead,et al.  Optimal detection of changepoints with a linear computational cost , 2011, 1101.1438.

[8]  P. Perron,et al.  Computation and Analysis of Multiple Structural-Change Models , 1998 .

[9]  David S. Matteson,et al.  ecp: An R Package for Nonparametric Multiple Change Point Analysis of Multivariate Data , 2013, 1309.3295.

[10]  Chandra Erdman,et al.  bcp: An R Package for Performing a Bayesian Analysis of Change Point Problems , 2007 .

[11]  Achim Zeileis,et al.  Strucchange: An R package for testing for structural change in linear regression models , 2002 .

[12]  Douglas M. Hawkins,et al.  A Multivariate Change-Point Model for Change in Mean Vector and/or Covariance Structure , 2009 .

[13]  Chandra Erdman,et al.  A fast Bayesian change point analysis for the segmentation of microarray data , 2008, Bioinform..

[14]  T. Ouarda,et al.  Bayesian multivariate linear regression with application to change point models in hydrometeorological variables , 2007 .

[15]  R. Prim Shortest connection networks and some generalizations , 1957 .

[16]  Donald Holbert,et al.  A Bayesian analysis of a switching linear model , 1982 .

[17]  Douglas M. Hawkins,et al.  A Multivariate Change-Point Model for Statistical Process Control , 2006, Technometrics.

[18]  Paul Fearnhead,et al.  Exact Bayesian curve fitting and signal segmentation , 2005, IEEE Transactions on Signal Processing.

[19]  P. McCullagh Partition models , 2015 .

[20]  Arjun K. Gupta,et al.  Parametric Statistical Change Point Analysis , 2000 .