Exact Bayesian inference for off-line change-point detection in tree-structured graphical models

We consider the problem of change-point detection in multivariate time-series. The multivariate distribution of the observations is supposed to follow a graphical model, whose graph and parameters are affected by abrupt changes throughout time. We demonstrate that it is possible to perform exact Bayesian inference whenever one considers a simple class of undirected graphs called spanning trees as possible structures. We are then able to integrate on the graph and segmentation spaces at the same time by combining classical dynamic programming with algebraic results pertaining to spanning trees. In particular, we show that quantities such as posterior distributions for change-points or posterior edge probabilities over time can efficiently be obtained. We illustrate our results on both synthetic and experimental data arising from biology and neuroscience.

[1]  Michael I. Jordan,et al.  Nonparametric Bayesian Learning of Switching Linear Dynamical Systems , 2008, NIPS.

[2]  Le Song,et al.  Estimating time-varying networks , 2008, ISMB 2008.

[3]  J. Hartigan,et al.  Product Partition Models for Change Point Problems , 1992 .

[4]  A. Dawid,et al.  Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models , 1993 .

[5]  I E Auger,et al.  Algorithms for the optimal identification of segment neighborhoods. , 1989, Bulletin of mathematical biology.

[6]  John W. Fisher,et al.  Tractable Bayesian Inference of Time-Series Dependence Structure , 2009, AISTATS.

[7]  E. Salmon.  Gene Expression During the Life Cycle of Drosophila melanogaster , 2002 .

[8]  Stéphane Robin,et al.  Bayesian Inference of Graphical Model Structures Using Trees , 2015 .

[9]  Stéphane Robin,et al.  Exact posterior distributions and model selection criteria for multiple change-point detection problems , 2012, Stat. Comput..

[10]  Kevin Murphy,et al.  Modelling Gene Expression Data using Dynamic Bayesian Networks , 2006 .

[11]  Kevin P. Murphy,et al.  Modeling changing dependency structure in multivariate time series , 2007, ICML '07.

[12]  Alexander J. Hartemink,et al.  Learning Non-Stationary Dynamic Bayesian Networks , 2010, J. Mach. Learn. Res..

[13]  P. Fearnhead,et al.  On‐line inference for multiple changepoint problems , 2007 .

[14]  Michael P. H. Stumpf,et al.  Statistical inference of the time-varying structure of gene-regulation networks , 2010, BMC Systems Biology.

[15]  Raphael Gottardo,et al.  On-line changepoint detection and parameter estimation with application to genomic data , 2012, Stat. Comput..

[16]  Martin A. Lindquist,et al.  Dynamic connectivity regression: Determining state-related changes in brain connectivity , 2012, NeuroImage.

[17]  R C Payne,et al.  Functional anatomy and muscle moment arms of the thoracic limb of an elite sprinting athlete: the racing greyhound (Canis familiaris) , 2008, Journal of anatomy.

[18]  Peter Spirtes,et al.  Graphical Models for the Identification of Causal Structures in Multivariate Time Series Models , 2006, JCIS.

[19]  Tommi S. Jaakkola,et al.  Tractable Bayesian learning of tree belief networks , 2000, Stat. Comput..

[20]  Marco Grzegorczyk,et al.  Improvements in the reconstruction of time-varying gene regulatory networks: dynamic programming and regularization by information sharing among genes , 2011, Bioinform..

[21]  Dirk Husmeier,et al.  Non-homogeneous dynamic Bayesian networks with Bayesian regularization for inferring gene regulatory networks with gradually time-varying structure , 2012, Machine Learning.

[22]  Larry A. Wasserman,et al.  Time varying undirected graphs , 2008, Machine Learning.

[23]  Paul Fearnhead,et al.  Exact and efficient Bayesian inference for multiple changepoint problems , 2006, Stat. Comput..

[24]  Michael I. Jordan.  Graphical Models , 2003 .

[25]  Edward R. Dougherty,et al.  Inferring gene regulatory networks from time series data using the minimum description length principle , 2006, Bioinform..

[26]  Kevin P. Murphy,et al.  Learning the Structure of Dynamic Probabilistic Networks , 1998, UAI.