Modelling sparsity, heterogeneity, reciprocity and community structure in temporal interaction data

We propose a novel class of network models for temporal dyadic interaction data. Our goal is to capture a number of important features often observed in social interactions: sparsity, degree heterogeneity, community structure and reciprocity. We propose a family of models based on self-exciting Hawkes point processes in which events depend on the history of the process. The key component is the conditional intensity function of the Hawkes Process, which captures the fact that interactions may arise as a response to past interactions (reciprocity), or due to shared interests between individuals (community structure). In order to capture the sparsity and degree heterogeneity, the base (non time dependent) part of the intensity function builds on compound random measures following Todeschini et al. (2016). We conduct experiments on a variety of real-world temporal interaction data and show that the proposed model outperforms many competing approaches for link prediction, and leads to interpretable parameters.

[1]  J. Kingman,et al.  Completely random measures. , 1967 .

[2]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[3]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[4]  J. Møller,et al.  Statistical Inference and Simulation for Spatial Point Processes , 2003 .

[5]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Katherine A. Heller,et al.  Modelling Reciprocating Relationships with Hawkes Processes , 2012, NIPS.

[7]  J. Rasmussen Bayesian Inference for Hawkes Processes , 2013 .

[8]  Padhraic Smyth,et al.  Stochastic blockmodeling of relational event dynamics , 2013, AISTATS.

[9]  Chong Wang,et al.  Modeling Overlapping Communities with Node Popularities , 2013, NIPS.

[10]  A. Dassios,et al.  Exact Simulation of Hawkes Process with Exponentially Decaying Intensity , 2013 .

[11]  Jure Leskovec,et al.  {SNAP Datasets}: {Stanford} Large Network Dataset Collection , 2014 .

[12]  Scott W. Linderman,et al.  Discovering Latent Network Structure in Point Process Data , 2014, ICML.

[13]  J. Griffin,et al.  Compound random measures and their use in Bayesian non‐parametrics , 2014, 1410.0611.

[14]  Mingyuan Zhou,et al.  Infinite Edge Partition Models for Overlapping Community Detection and Link Prediction , 2015, AISTATS.

[15]  W. Dempsey,et al.  A framework for statistical network modeling , 2015, 1509.08185.

[16]  Daniel M. Roy,et al.  The Class of Random Graphs Arising from Exchangeable Random Measures , 2015, ArXiv.

[17]  Ulrike Goldschmidt,et al.  An Introduction To The Theory Of Point Processes , 2016 .

[18]  Sinead Williamson,et al.  Nonparametric Network Models for Link Prediction , 2016, J. Mach. Learn. Res..

[19]  Yee Whye Teh,et al.  Bayesian nonparametrics for Sparse Dynamic Networks , 2016 .

[20]  Morten Mørup,et al.  Completely random measures for modelling block-structured sparse networks , 2016, NIPS.

[21]  Trevor Campbell,et al.  Edge-exchangeable graphs and sparsity , 2016, NIPS.

[22]  Emily B. Fox,et al.  Sparse graphs using exchangeable random measures , 2014, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[23]  S. Janson On convergence for graphexes , 2017, 1702.06389.

[24]  Christian Borgs,et al.  Sparse Exchangeable Graphs and Their Limits via Graphon Processes , 2016, J. Mach. Learn. Res..

[25]  Christian P. Robert,et al.  Better together? Statistical learning in models made of modules , 2017, 1708.08719.

[26]  Ricardo Silva,et al.  A Dynamic Edge Exchangeable Model for Sparse Temporal Networks , 2017, ArXiv.

[27]  W. Dempsey,et al.  Edge Exchangeable Models for Interaction Networks , 2018, Journal of the American Statistical Association.

[28]  S. Janson On Edge Exchangeable Random Graphs , 2017, Journal of statistical physics.

[29]  Adrien Todeschini,et al.  Exchangeable random measures for sparse and modular graphs with overlapping communities , 2016, Journal of the Royal Statistical Society: Series B (Statistical Methodology).