Bayesian Shrinkage for Functional Network Models with Intractable Normalizing Constants

Longitudinal network models are widely used to study the time-varying relationships between items (nodes), such as analyzing the relations among survey questions and studying friendship dynamics in school data over time. We propose a new model to study these temporal interactions among items by embedding the functional parameters within the exponential random graph model framework. Inference on such models is difficult because the likelihood functions contain intractable normalizing constants. Furthermore, the number of functional parameters grows exponentially as the number of items increases. Variable selection for such models is not trivial because standard shrinkage approaches do not consider temporal trends in functional parameters. To overcome these challenges, we develop a novel Bayes approach by combining an auxiliary variable MCMC algorithm and a recently developed functional shrinkage method. We apply our algorithm to two survey data sets and hotel review data, illustrating that the proposed approach can avoid the evaluation of intractable normalizing constants as well as detect significant temporal interactions among items. Through a simulation study under different scenarios, we examine the performance of our algorithm. Our method is, to our knowledge, the first attempt to select functional variables for models with intractable normalizing constants.

[1]  A. B. Knecht,et al.  Friendship selection and friends' influence. Dynamics of networks and actor attributes in early adolescence , 2002 .

[2]  Christian P. Robert,et al.  Bayesian computation for statistical models with intractable normalizing constants , 2008, 0804.3152.

[3]  Murali Haran,et al.  Markov chain Monte Carlo: Can we trust the third significant figure? , 2007, math/0703746.

[4]  Ledyard R Tucker,et al.  Determination of parameters of a functional relation by factor analysis , 1958 .

[5]  S. Rabe-Hesketh,et al.  An autoregressive growth model for longitudinal item analysis , 2016, Psychometrika.

[6]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[7]  Faming Liang,et al.  A double Metropolis–Hastings sampler for spatial models with intractable normalizing constants , 2010 .

[8]  Yuguo Chen,et al.  Latent Space Models for Dynamic Networks , 2015, 2005.08808.

[9]  Pavel N Krivitsky,et al.  A separable model for dynamic networks , 2010, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[10]  Garry Robins,et al.  An introduction to exponential random graph (p*) models for social networks , 2007, Soc. Networks.

[11]  Carol A. Schubert,et al.  Theory and Research on Desistance from Antisocial Activity among Serious Adolescent Offenders , 2004, Youth violence and juvenile justice.

[12]  Galin L. Jones,et al.  Fixed-Width Output Analysis for Markov Chain Monte Carlo , 2006, math/0601446.

[13]  Yves F. Atchad'e,et al.  On Russian Roulette Estimates for Bayesian Inference with Doubly-Intractable Likelihoods , 2013, 1306.4032.

[14]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[15]  Ove Frank,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[16]  Marieke Wichers,et al.  Mindfulness training increases momentary positive emotions and reward experience in adults vulnerable to depression: a randomized controlled trial. , 2011, Journal of consulting and clinical psychology.

[17]  Eric P. Xing,et al.  Discrete Temporal Models of Social Networks , 2006, SNA@ICML.

[18]  Jaewoo Park,et al.  Bayesian Inference in the Presence of Intractable Normalizing Functions , 2017, Journal of the American Statistical Association.

[19]  Zoubin Ghahramani,et al.  MCMC for Doubly-intractable Distributions , 2006, UAI.

[20]  Martina Morris,et al.  ergm: A Package to Fit, Simulate and Diagnose Exponential-Family Models for Networks. , 2008, Journal of statistical software.

[21]  E. Segawa A Growth Model for Multilevel Ordinal Data , 2005 .

[22]  D. Andrade,et al.  Item response theory for longitudinal data: population parameter estimation , 2005 .

[23]  Claudia D. van Borkulo,et al.  A new method for constructing networks from binary data , 2014, Scientific Reports.

[24]  Minjeong Jeon,et al.  Profile-Likelihood Approach for Estimating Generalized Linear Mixed Models With Factor Structures , 2012 .

[25]  Minjeong Jeon,et al.  A Doubly Latent Space Joint Model for Local Item and Person Dependence in the Analysis of Item Response Data , 2016, Psychometrika.

[26]  V. Johnson,et al.  Functional Horseshoe Priors for Subspace Shrinkage , 2016, Journal of the American Statistical Association.

[27]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[28]  Jaewoo Park,et al.  A Function Emulation Approach for Doubly Intractable Distributions , 2018, Journal of Computational and Graphical Statistics.

[29]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[30]  James G. Scott,et al.  The horseshoe estimator for sparse signals , 2010 .

[31]  D. Dunson Dynamic Latent Trait Models for Multidimensional Longitudinal Data , 2003 .

[32]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[33]  Rohit Verma,et al.  What Guests Really Think of Your Hotel: Text Analytics of Online Customer Reviews , 2016 .

[34]  D. Borsboom,et al.  A Network Approach to Psychopathology: New Insights into Clinical Longitudinal Data , 2013, PloS one.

[35]  Jaewoo Park,et al.  Bayesian Model Selection for Ultrahigh-Dimensional Doubly-Intractable Distributions with an Application to Network Psychometrics , 2019 .

[36]  C. R. Rao,et al.  Some statistical methods for comparison of growth curves. , 1958 .

[37]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[38]  James O. Ramsay,et al.  Applied Functional Data Analysis: Methods and Case Studies , 2002 .

[39]  Silvia Cagnone,et al.  A Composite Likelihood Inference in Latent Variable Models for Ordinal Longitudinal Responses , 2012, Psychometrika.