Bayesian inference for low-rank Ising networks

Estimating the structure of Ising networks is a notoriously difficult problem. We demonstrate that using a latent variable representation of the Ising network, we can employ a full-data-information approach to uncover the network structure. Thereby, only ignoring information encoded in the prior distribution (of the latent variables). The full-data-information approach avoids having to compute the partition function and is thus computationally feasible, even for networks with many nodes. We illustrate the full-data-information approach with the estimation of dense networks.

[1]  C. Møller.  Brandeis University Summer Institute in Theoretical Physics 1960 : lecture notes , 1960 .

[2]  Danielle M. Varda,et al.  A Network Perspective , 2009 .

[3]  Book Reviews,et al.  Looking Down on Human Intelligence: From Psychometrics to the Brain , 2001 .

[4]  E. Ising.  Beitrag zur Theorie des Ferromagnetismus , 1925 .

[5]  Peter McCullagh,et al.  Exponential mixtures and quadratic exponential families , 1994 .

[6]  Ian J. Deary,et al.  Looking down on human intelligence , 2000 .

[7]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[8]  N. Wermuth,et al.  Graphical Models for Associations between Variables, some of which are Qualitative and some Quantitative , 1989 .

[9]  Jeroen K. Vermunt,et al.  Estimation of Models in a Rasch Family for Polytomous Items and Multiple Latent Variables , 2007 .

[10]  A. Béguin,et al.  MCMC estimation and some model-fit analysis of multidimensional IRT models , 2001 .

[11]  Verena D. Schmittmann,et al.  Qgraph: Network visualizations of relationships in psychometric data , 2012 .

[12]  J. Besag.  Statistical Analysis of Non-Lattice Data , 1975 .

[13]  T. D. Lee,et al.  Statistical Theory of Equations of State and Phase Transitions. II. Lattice Gas and Ising Model , 1952 .

[14]  Claudia D. van Borkulo,et al.  A new method for constructing networks from binary data , 2014, Scientific Reports.

[15]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ingram Olkin,et al.  Multivariate Correlation Models with Mixed Discrete and Continuous Variables , 1961 .

[17]  R. Krueger,et al.  Toward scientifically useful quantitative models of psychopathology: The importance of a comparative approach , 2010, Behavioral and Brain Sciences.

[18]  Gérard G. Emch,et al.  Pure Thermodynamical Phases as Extremal KMS States , 1970 .

[19]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[20]  Erik Taal,et al.  Items and dimensions for the construction of a multidimensional computerized adaptive test to measure fatigue in patients with rheumatoid arthritis. , 2013, Journal of clinical epidemiology.

[21]  Guido Makransky,et al.  Improving Personality Facet Scores With Multidimensional Computer Adaptive Testing , 2013, Assessment.

[22]  Brian W. Junker,et al.  Applications and Extensions of MCMC in IRT: Multiple Item Types, Missing Data, and Rated Responses , 1999 .

[23]  J. Albert.  Bayesian Estimation of Normal Ogive Item Response Curves Using Gibbs Sampling , 1992 .

[24]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[25]  M. Reckase.  Multidimensional Item Response Theory , 2009 .

[26]  Hsiu-Ting Yu,et al.  Log-Multiplicative Association Models as Item Response Models , 2007 .

[27]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[28]  H.L.J. van der Maas,et al.  A dynamical model of general intelligence: the positive manifold of intelligence by mutualism. , 2006, Psychological review.

[29]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[30]  A. Jensen,et al.  The g factor , 1996, Nature.

[31]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[32]  E. Maris,et al.  A MCMC-method for models with continuous latent responses , 2002 .

[33]  R. B. Potts.  Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[34]  Richard J. Patz,et al.  A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models , 1999 .

[35]  Terry A. Ackerman.  Developments in Multidimensional Item Response Theory , 1996 .

[36]  T. Bechger,et al.  Bayesian inference for low-rank Ising , 2015 .

[37]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .