Efficient sampling of Gaussian graphical models using conditional Bayes factors

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart dis- tribution, has a doubly intractable partition function. Recent developments provide a direct way to sample from the G-Wishart distribution, which allows for more ecient algorithms for model selection than previously possible. Still, estimating Gaussian graphical models with more than a handful of variables remains a nearly infeasible task. Here, we propose two novel algo- rithms that use the direct sampler to more eciently approximate the posterior distribution of the Gaussian graphical model. The rst algorithm uses conditional Bayes factors to compare models in a Metropolis-Hastings framework. The second algorithm is based on a continuous time Markov process. We show that both algorithms are substantially faster than state-of-the- art alternatives. Finally, we show how the algorithms may be used to simultaneously estimate both structural and functional connectivity between subcortical brain regions using resting-state fMRI.

[1]  Luca Ambrogioni,et al.  Structurally-informed Bayesian functional connectivity analysis , 2014, NeuroImage.

[2]  O. Cappé,et al.  Reversible jump, birth‐and‐death and more general continuous time Markov chain Monte Carlo samplers , 2003 .

[3]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[4]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[5]  Yuan Cheng,et al.  Hierarchical Gaussian graphical models: Beyond reversible jump , 2012 .

[6]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[7]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[8]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[9]  Mohammad Emtiyaz Khan,et al.  Accelerating Bayesian Structural Inference for Non-Decomposable Gaussian Graphical Models , 2009, NIPS.

[10]  Yee Whye Teh,et al.  MCMC for continuous-time discrete-state systems , 2012, NIPS.

[11]  Abel Rodriguez,et al.  Bayesian Inference for General Gaussian Graphical Models With Application to Multivariate Lattice Data , 2010, Journal of the American Statistical Association.

[12]  Zoubin Ghahramani,et al.  MCMC for Doubly-intractable Distributions , 2006, UAI.

[13]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[14]  Stephen M. Smith,et al.  A Bayesian model of shape and appearance for subcortical brain segmentation , 2011, NeuroImage.

[15]  Mauro Piccioni,et al.  Independence Structure of Natural Conjugate Densities to Exponential Families and the Gibbs' Sampler , 2000 .

[16]  Thomas E. Nichols,et al.  Functional connectomics from resting-state fMRI , 2013, Trends in Cognitive Sciences.

[17]  Alex Lenkoski,et al.  A direct sampler for G‐Wishart variates , 2013, 1304.1350.

[18]  E. S. B. van Oort,et al.  An investigation into the functional and structural connectivity of the Default Mode Network , 2014, NeuroImage.

[19]  A. Roverato Hyper Inverse Wishart Distribution for Non-decomposable Graphs and its Application to Bayesian Inference for Gaussian Graphical Models , 2002 .

[20]  Hao Wang,et al.  Efficient Gaussian graphical model determination under G-Wishart prior distributions , 2012 .

[21]  A. Atay-Kayis,et al.  A Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models , 2005 .

[22]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[23]  A. Dobra,et al.  Copula Gaussian graphical models and their application to modeling functional disability data , 2011, 1108.1680.

[24]  Karl J. Friston Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[25]  Faming Liang,et al.  A double Metropolis–Hastings sampler for spatial models with intractable normalizing constants , 2010 .

[26]  M. Stephens Bayesian analysis of mixture models with an unknown number of components- an alternative to reversible jump methods , 2000 .

[27]  D. Norris,et al.  BOLD contrast sensitivity enhancement and artifact reduction with multiecho EPI: Parallel‐acquired inhomogeneity‐desensitized fMRI , 2006, Magnetic resonance in medicine.

[28]  Ernst Wit,et al.  Bayesian model selection in sparse Gaussian graphical models , 2014 .

[29]  A. Mohammadi,et al.  Bayesian Structure Learning in Sparse Gaussian Graphical Models , 2012, 1210.5371.

[30]  Nicholas Mitsakakis,et al.  A Metropolis-Hastings based method for sampling from the G-Wishart distribution in Gaussian graphical models , 2011 .

[31]  A. Dawid,et al.  Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models , 1993 .

[32]  P. Diaconis,et al.  Conjugate Priors for Exponential Families , 1979 .

[33]  D. V. van Essen,et al.  Challenges and Opportunities in Mining Neuroscience Data , 2011, Science.