Are You Going to the Party: Depends, Who Else is Coming?: [Learning Hidden Group Dynamics via Conditional Latent Tree Models]

Scalable probabilistic modeling and prediction in high dimensional multivariate time-series, such as dynamic social networks with co-evolving nodes and edges, is a challenging problem, particularly for systems with hidden sources of dependence and/or homogeneity. Here, we address this problem through the discovery of hierarchical latent groups. We introduce a family of Conditional Latent Tree Models (CLTM), in which tree-structured latent variables incorporate the unknown groups. The latent tree itself is conditioned on observed covariates such as seasonality, historical activity, and node attributes. We propose a statistically efficient framework for learning both the hierarchical tree structure and the parameters of the CLTM. We demonstrate competitive performance on two real world datasets, one from the students' attempts at answering questions in a psychology MOOC and the other from Twitter users participating in an emergency management discussion and interacting with one another. In addition, our modeling framework provides valuable and interpretable information about the hidden group structures and their effect on the evolution of the time series.

[1]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[2]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[3]  L. Freeman,et al.  On human social intelligence , 1988 .

[4]  Arunabha Sen,et al.  On a Graph Partition Problem with Application to VLSI Layout , 1992, Inf. Process. Lett..

[5]  P. Royston,et al.  Regression using fractional polynomials of continuous covariates: parsimonious parametric modelling. , 1994 .

[6]  T. Snijders Stochastic actor-oriented models for network change , 1996 .

[7]  Marijtje A. J. van Duijn,et al.  Simulation for Statistical Inference in Dynamic Network Models , 1997 .

[8]  D. Kundu,et al.  EXPONENTIATED EXPONENTIAL FAMILY: AN ALTERNATIVE TO GAMMA AND WEIBULL DISTRIBUTIONS , 2001 .

[9]  T. Snijders The statistical evaluation of social network dynamics , 2001 .

[10]  Martial Hebert,et al.  Discriminative Fields for Modeling Spatial Dependencies in Natural Images , 2003, NIPS.

[11]  Fernando Pereira,et al.  Shallow Parsing with Conditional Random Fields , 2003, NAACL.

[12]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[13]  Antonio Torralba,et al.  Contextual Models for Object Detection Using Boosted Random Fields , 2004, NIPS.

[14]  T. Snijders Models for longitudinal network datain , 2005 .

[15]  Eric P. Xing,et al.  Discrete Temporal Models of Social Networks , 2006, SNA@ICML.

[16]  Trevor Darrell,et al.  Hidden Conditional Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Carter T. Butts,et al.  4. A Relational Event Framework for Social Action , 2008 .

[18]  Mark W. Schmidt,et al.  Structure learning in random fields for heart motion abnormality detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  L. Brown In-season prediction of batting averages: A field test of empirical Bayes and Bayes methodologies , 2008, 0803.3697.

[20]  E. Xing,et al.  Discrete Temporal Models of Social Networks , 2006, SNA@ICML.

[21]  Joseph K. Bradley,et al.  Learning Tree Conditional Random Fields , 2010, ICML.

[22]  E. Xing,et al.  A state-space mixed membership blockmodel for dynamic network tomography , 2008, 0901.0135.

[23]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[24]  James R. Foulds,et al.  A Dynamic Relational Infinite Feature Model for Longitudinal Social Networks , 2011, AISTATS.

[25]  Vincent Y. F. Tan,et al.  Learning Latent Tree Graphical Models , 2010, J. Mach. Learn. Res..

[26]  Padhraic Smyth,et al.  Hierarchical Models for Relational Event Sequences , 2012, 1207.7306.

[27]  Sivaraman Balakrishnan,et al.  Efficient Active Algorithms for Hierarchical Clustering , 2012, ICML.

[28]  Bruce A. Desmarais,et al.  Statistical Mechanics of Networks: Estimation and Uncertainty Forthcoming: Physica A , 2012 .

[29]  Anima Anandkumar,et al.  A Tensor Spectral Approach to Learning Mixed Membership Community Models , 2013, COLT.

[30]  Jure Leskovec,et al.  Community Detection in Networks with Node Attributes , 2013, 2013 IEEE 13th International Conference on Data Mining.

[31]  Candace Thille,et al.  An Approach to Knowledge Component/Skill Modeling in Online Courses , 2014 .

[32]  Anima Anandkumar,et al.  A tensor approach to learning mixed membership community models , 2013, J. Mach. Learn. Res..

[33]  Jennifer Neville,et al.  Learning the Latent State Space of Time-Varying Graphs , 2014, ArXiv.

[34]  Zack W. Almquist,et al.  Logistic Network Regression for Scalable Analysis of Networks with Joint Edge/Vertex Dynamics , 2011, Sociological methodology.

[35]  Thomas Brendan Murphy,et al.  Mixed-membership of experts stochastic blockmodel , 2014, Network Science.

[36]  Malik Magdon-Ismail,et al.  Extracting Hidden Groups and their Structure from Streaming Interaction Data , 2015, ArXiv.