Efficient Gaussian graphical model determination under G-Wishart prior distributions

This paper proposes a new algorithm for Bayesian model determination in Gaussian graphical models under G-Wishart prior distributions. We first review recent development in sampling from G-Wishart distributions for given graphs, with a particular interest in the efficiency of the block Gibbs samplers and other competing methods. We generalize the maximum clique block Gibbs samplers to a class of flexible block Gibbs samplers and prove its convergence. This class of block Gibbs samplers substantially outperforms its competitors along a variety of dimensions. We next develop the theory and computational details of a novel Markov chain Monte Carlo sampling scheme for Gaussian graphical model determination. Our method relies on the partial analytic structure of G-Wishart distributions integrated with the exchange algorithm. Unlike existing methods, the new method requires neither proposal tuning nor evaluation of normalizing constants of G-Wishart distributions.

[1]  E. Fama,et al.  Common risk factors in the returns on stocks and bonds , 1993 .

[2]  Hao Wang,et al.  Dynamic financial index models: Modeling conditional dependencies via graphs , 2011 .

[3]  Michael A. West,et al.  Archival Version including Appendicies : Experiments in Stochastic Computation for High-Dimensional Graphical Models , 2005 .

[4]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo in Practice: A Roundtable Discussion , 1998 .

[5]  James G. Scott,et al.  Feature-Inclusion Stochastic Search for Gaussian Graphical Models , 2008 .

[6]  Daren E. Miller Mutual Fund Performance and Seemingly Unrelated Assets , 2002 .

[7]  Abel Rodríguez,et al.  Sparse covariance estimation in heterogeneous samples. , 2010, Electronic journal of statistics.

[8]  Nicholas Mitsakakis,et al.  A Metropolis-Hastings based method for sampling from the G-Wishart distribution in Gaussian graphical models , 2011 .

[9]  A. Roverato Hyper Inverse Wishart Distribution for Non-decomposable Graphs and its Application to Bayesian Inference for Gaussian Graphical Models , 2002 .

[10]  Carlos M. Carvalho,et al.  Simulation of Hyper-Inverse Wishart Distributions for Non-decomposable Graphs , 2010 .

[11]  A. Atay-Kayis,et al.  A Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models , 2005 .

[12]  Zoubin Ghahramani,et al.  MCMC for Doubly-intractable Distributions , 2006, UAI.

[13]  Michael A. West,et al.  Dynamic matrix-variate graphical models , 2007 .

[14]  M. West,et al.  Simulation of hyper-inverse Wishart distributions in graphical models , 2007 .

[15]  S. Godsill On the Relationship Between Markov chain Monte Carlo Methods for Model Uncertainty , 2001 .

[16]  Adrian Dobra,et al.  Copula Gaussian Graphical Models * , 2009 .

[17]  Abel Rodriguez,et al.  Bayesian Inference for General Gaussian Graphical Models With Application to Multivariate Lattice Data , 2010, Journal of the American Statistical Association.

[18]  Mauro Piccioni,et al.  Independence Structure of Natural Conjugate Densities to Exponential Families and the Gibbs' Sampler , 2000 .

[19]  Iain Murray Advances in Markov chain Monte Carlo methods , 2007 .

[20]  M. West,et al.  Bayesian analysis of matrix normal graphical models. , 2009, Biometrika.

[21]  C. Bron,et al.  Algorithm 457: finding all cliques of an undirected graph , 1973 .

[22]  Hao Wang,et al.  Sparse seemingly unrelated regression modelling: Applications in finance and econometrics , 2010, Comput. Stat. Data Anal..

[23]  P. Green,et al.  Decomposable graphical Gaussian model determination , 1999 .

[24]  E. George,et al.  APPROACHES FOR BAYESIAN VARIABLE SELECTION , 1997 .

[25]  Carlos M. Carvalho,et al.  FLEXIBLE COVARIANCE ESTIMATION IN GRAPHICAL GAUSSIAN MODELS , 2008, 0901.3267.

[26]  Adrian Dobra,et al.  Computational Aspects Related to Inference in Gaussian Graphical Models With the G-Wishart Prior , 2011 .

[27]  D. V. van Dyk,et al.  Partially Collapsed Gibbs Samplers , 2008 .

[28]  A. Dobra,et al.  Copula Gaussian graphical models and their application to modeling functional disability data , 2011, 1108.1680.

[29]  W. Sharpe CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK* , 1964 .

[30]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[31]  Faming Liang,et al.  A double Metropolis–Hastings sampler for spatial models with intractable normalizing constants , 2010 .