Bayesian Graphical Models for Differential Pathways

Graphical models can be used to characterize the dependence structure for a set of random variables. In some applications, the form of dependence varies across different subgroups. This situation arises, for example, when protein activation on a certain pathway is recorded, and a subgroup of patients is characterized by a pathological disruption of that pathway. A similar situation arises when one subgroup of patients is treated with a drug that targets that same pathway. In both cases, understanding changes in the joint distribution and dependence structure across the two subgroups is key to the desired inference. Fitting a single model for the entire data could mask the differences. Separate independent analyses, on the other hand, could reduce the effective sample size and ignore the common features. In this paper, we develop a Bayesian graphical model that addresses heterogeneity and implements borrowing of strength across the two subgroups by simultaneously centering the prior towards a global network. The key feature is a hierarchical prior for graphs that borrows strength across edges, resulting in a comparison of pathways across subpopulations (differential pathways) under a unified model-based framework. We apply the proposed model to data sets from two very different studies: histone modifications from ChIP-seq experiments, and protein measurements based on tissue microarrays.

[1]  S. Wright.  The Method of Path Coefficients , 1934 .

[2]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[3]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[4]  Ming-Hui Chen,et al.  On Monte Carlo methods for estimating ratios of normalizing constants , 1997 .

[5]  Chris Lloyd,et al.  Using Smoothed Receiver Operating Characteristic Curves to Summarize and Compare Diagnostic Systems , 1998 .

[6]  P. Green,et al.  Decomposable graphical Gaussian model determination , 1999 .

[7]  Mauro Piccioni,et al.  Independence Structure of Natural Conjugate Densities to Exponential Families and the Gibbs' Sampler , 2000 .

[8]  C. Allis,et al.  The language of covalent histone modifications , 2000, Nature.

[9]  W. Michael Conklin,et al.  Monte Carlo Methods in Bayesian Computation , 2001, Technometrics.

[10]  Steffen L. Lauritzen,et al.  Graphical Models for Genetic Analyses , 2003 .

[11]  R. Kohn,et al.  Efficient estimation of covariance selection models , 2003 .

[12]  Michael A. West,et al.  Archival Version including Appendicies : Experiments in Stochastic Computation for High-Dimensional Graphical Models , 2005 .

[13]  M. West,et al.  Sparse graphical models for exploring gene expression data , 2004 .

[14]  N. Friedman,et al.  Single-Nucleosome Mapping of Histone Modifications in S. cerevisiae , 2005, PLoS biology.

[15]  A. Atay-Kayis,et al.  A Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models , 2005 .

[16]  J. Møller,et al.  An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants , 2006 .

[17]  James G. Scott,et al.  An exploration of aspects of Bayesian multiple testing , 2006 .

[18]  N. Meinshausen,et al.  High-dimensional graphs and variable selection with the Lasso , 2006, math/0608017.

[19]  Kenneth Rice,et al.  FDR and Bayesian Multiple Comparisons Rules , 2006 .

[20]  M. West,et al.  Simulation of hyper-inverse Wishart distributions in graphical models , 2007 .

[21]  M. Yuan,et al.  Model selection and estimation in the Gaussian graphical model , 2007 .

[22]  Dustin E. Schones,et al.  High-Resolution Profiling of Histone Methylations in the Human Genome , 2007, Cell.

[23]  S. Kurdistani.  Histone modifications as markers of cancer prognosis: a cellular view , 2007, British Journal of Cancer.

[24]  James G. Scott,et al.  Feature-Inclusion Stochastic Search for Gaussian Graphical Models , 2008 .

[25]  Christian P. Robert,et al.  Bayesian computation for statistical models with intractable normalizing constants , 2008, 0804.3152.

[26]  Michael Q. Zhang,et al.  Combinatorial patterns of histone acetylations and methylations in the human genome , 2008, Nature Genetics.

[27]  James G. Scott,et al.  Objective Bayesian model selection in Gaussian graphical models , 2009 .

[28]  Carlos M. Carvalho,et al.  Simulation of Hyper-Inverse Wishart Distributions for Non-decomposable Graphs , 2010 .

[29]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[30]  Jie Lv,et al.  HHMD: the human histone modification database , 2009, Nucleic Acids Res..

[31]  James G. Scott,et al.  Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem , 2010, 1011.2333.

[32]  Francesco C Stingo,et al.  A BAYESIAN GRAPHICAL MODELING APPROACH TO MICRORNA REGULATORY NETWORK INFERENCE. , 2011, The annals of applied statistics.

[33]  Abel Rodriguez,et al.  Bayesian Inference for General Gaussian Graphical Models With Application to Multivariate Lattice Data , 2010, Journal of the American Statistical Association.

[34]  Nicholas Mitsakakis,et al.  A Metropolis-Hastings based method for sampling from the G-Wishart distribution in Gaussian graphical models , 2011 .

[35]  Abel Rodríguez,et al.  Sparse covariance estimation in heterogeneous samples. , 2010, Electronic journal of statistics.

[36]  A. Dobra,et al.  Copula Gaussian graphical models and their application to modeling functional disability data , 2011, 1108.1680.

[37]  Christophe Ambroise,et al.  Inferring multiple graphical structures , 2009, Stat. Comput..

[38]  Adrian Dobra,et al.  Computational Aspects Related to Inference in Gaussian Graphical Models With the G-Wishart Prior , 2011 .

[39]  S. Kurdistani.  Histone modifications in cancer biology and prognosis. , 2011, Progress in drug research. Fortschritte der Arzneimittelforschung. Progres des recherches pharmaceutiques.

[40]  Seungyeop Han,et al.  Structured Learning of Gaussian Graphical Models , 2012, NIPS.

[41]  Yu Zhang,et al.  A novel bayesian graphical model for genome‐wide multi‐SNP association mapping , 2012, Genetic epidemiology.

[42]  Pradeep Ravikumar,et al.  Graphical Models via Generalized Linear Models , 2012, NIPS.

[43]  Hao Wang,et al.  Bayesian Graphical Lasso Models and Efficient Posterior Computation , 2012 .

[44]  Hao Wang,et al.  Efficient Gaussian graphical model determination under G-Wishart prior distributions , 2012 .

[45]  Takashi Washio,et al.  Learning a common substructure of multiple graphical Gaussian models , 2012, Neural Networks.

[46]  Yuan Ji,et al.  A Bayesian Graphical Model for ChIP-Seq Data on Histone Modifications , 2013 .

[47]  Su-In Lee,et al.  Node-based learning of multiple Gaussian graphical models , 2013, J. Mach. Learn. Res..

[48]  Patrick Danaher,et al.  The joint graphical lasso for inverse covariance estimation across multiple classes , 2011, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[49]  Christine B Peterson,et al.  Bayesian Inference of Multiple Gaussian Graphical Models , 2015, Journal of the American Statistical Association.

[50]  Pradeep Ravikumar,et al.  Graphical models via univariate exponential family distributions , 2013, J. Mach. Learn. Res..

[51]  Ali Shojaie,et al.  Selection and estimation for mixed graphical models. , 2013, Biometrika.