Geometric Hawkes Processes with Graph Convolutional Recurrent Neural Networks

Hawkes processes are popular for modeling correlated temporal sequences that exhibit mutual-excitation properties. Existing approaches such as feature-enriched processes or variations of Multivariate Hawkes processes either fail to describe the exact mutual influence between sequences or become computational inhibitive in most real-world applications involving large dimensions. Incorporating additional geometric structure in the form of graphs into Hawkes processes is an effective and efficient way for improving model prediction accuracy. In this paper, we propose the Geometric Hawkes Process (GHP) model to better correlate individual processes, by integrating Hawkes processes and a graph convolutional recurrent neural network. The deep network structure is computational efficient since it requires constant parameters that are independent of the graph size. The experiment results on real-world data show that our framework outperforms recent state-of-art methods.

[1]  Rebecca Willett,et al.  Tracking Dynamic Point Processes on Networks , 2014, IEEE Transactions on Information Theory.

[2]  Taihei Oki,et al.  Multi-dimensional Graph Fourier Transform , 2017, ArXiv.

[3]  Le Song,et al.  Time-Sensitive Recommendation From Recurrent User Activities , 2015, NIPS.

[4]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[5]  Pradeep Ravikumar,et al.  Collaborative Filtering with Graph Information: Consistency and Scalable Methods , 2015, NIPS.

[6]  Xavier Bresson,et al.  Matrix Completion on Graphs , 2014, NIPS 2014.

[7]  Patrice Y. Simard,et al.  High Performance Convolutional Neural Networks for Document Processing , 2006 .

[8]  Le Song,et al.  Learning Social Infectivity in Sparse Low-rank Networks Using Multi-dimensional Hawkes Processes , 2013, AISTATS.

[9]  P. Grambsch.  Survival and Event History Analysis: A Process Point of View by AALEN, O. O., BORGAN, O., and GJESSING, H. K. , 2009 .

[10]  Niao He,et al.  Nonparametric Hawkes Processes: Online Estimation and Generalization Bounds , 2018, 1801.08273.

[11]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[12]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[13]  Hongyuan Zha,et al.  Learning Granger Causality for Hawkes Processes , 2016, ICML.

[14]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[15]  Shamim Nemati,et al.  Patient Flow Prediction via Discriminative Learning of Mutually-Correcting Processes , 2016, IEEE Transactions on Knowledge and Data Engineering.

[16]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[17]  Le Song,et al.  Coevolutionary Latent Feature Processes for Continuous-Time User-Item Interactions , 2016, NIPS.

[18]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[19]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[20]  Thomas Josef Liniger,et al.  Multivariate Hawkes processes , 2009 .

[21]  R. Dahlhaus,et al.  Graphical Modeling for Multivariate Hawkes Processes with Nonparametric Link Functions , 2016, 1605.06759.

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Mingxuan Sun,et al.  Local Low-Rank Hawkes Processes for Temporal User-Item Interactions , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[24]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[25]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[26]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[27]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[28]  Argyris Kalogeratos,et al.  Multivariate Hawkes Processes for Large-Scale Inference , 2016, AAAI.

[29]  Tamara G. Kolda,et al.  On Tensors, Sparsity, and Nonnegative Factorizations , 2011, SIAM J. Matrix Anal. Appl..

[30]  Kun Zhang,et al.  Learning Network of Multivariate Hawkes Processes: A Time Series Approach , 2016, UAI.

[31]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[32]  Le Song,et al.  Shaping Social Activity by Incentivizing Users , 2014, NIPS.

[33]  Xavier Bresson,et al.  Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks , 2017, NIPS.