Recent Advance in Temporal Point Process : from Machine Learning Perspective

Temporal point process (TPP) has served as a versatile framework for modeling event sequences in continuous time space. It spans a wide range of applications as event data is prevalent and becoming increasingly available such as online purchase, device failure. Tailored TPP learning algorithms are devised to different special processes, complemented by recent neural network based approaches. In general, traditional statistical TPP models are more interpretable and less data ravenous, which lay their success on appropriate selection of the intensity function via domain knowledge. In contrast, emerging network based models have higher capacity to digest massive event data with less reliance on model selection. However their physical meaning becomes less comprehensible. From machine learning perspective, this survey presents a literature review on these two threads of research. We walk through several working examples to provide a concrete disclosure of representative techniques.

[1]  A. Hawkes Point Spectra of Some Mutually Exciting Point Processes , 1971 .

[2]  Izhak Rubin,et al.  Regular point processes and their detection , 1972, IEEE Trans. Inf. Theory.

[3]  A. Hawkes,et al.  A cluster process representation of a self-exciting process , 1974, Journal of Applied Probability.

[4]  V. Isham,et al.  A self-correcting point process , 1979 .

[5]  T. Ozaki Maximum likelihood estimation of Hawkes' self-exciting point processes , 1979 .

[6]  Yosihiko Ogata,et al.  On Lewis' simulation method for point processes , 1981, IEEE Trans. Inf. Theory.

[7]  A S Fotheringham,et al.  The Modifiable Areal Unit Problem in Multivariate Statistical Analysis , 1991 .

[8]  Peter Hall,et al.  Bootstrap Confidence Regions for the Intensity of a Poisson Point Process , 1996 .

[9]  J. Klein,et al.  Survival Analysis: Techniques for Censored and Truncated Data , 1997 .

[10]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[11]  A. ADoefaa,et al.  ? ? ? ? f ? ? ? ? ? , 2003 .

[12]  Vanessa Didelez,et al.  Graphical models for marked point processes based on local independence , 2007, 0710.5874.

[13]  A. Veen,et al.  Estimation of Space–Time Branching Process Models in Seismology Using an EM–Type Algorithm , 2006 .

[14]  A survey of random processes with reinforcement , 2007, math/0610076.

[15]  D. Marsan,et al.  Extending Earthquakes' Reach Through Cascading , 2008, Science.

[16]  Esko Valkeila,et al.  An Introduction to the Theory of Point Processes, Volume II: General Theory and Structure, 2nd Edition by Daryl J. Daley, David Vere‐Jones , 2008 .

[17]  Thomas Josef Liniger,et al.  Multivariate Hawkes processes , 2009 .

[18]  Roy L. Streit,et al.  Poisson Point Processes , 2010 .

[19]  Chunpeng Fan,et al.  LOCAL LIKELIHOOD FOR INTERVAL-CENSORED AND AGGREGATED POINT PROCESS DATA , 2010 .

[20]  Kay Giesecke,et al.  Affine Point Processes and Portfolio Credit Risk , 2010, SIAM J. Financial Math..

[21]  P. Reynaud-Bouret,et al.  Adaptive estimation for Hawkes processes; application to genome analysis , 2009, 0903.2919.

[22]  George E. Tita,et al.  Self-Exciting Point Process Modeling of Crime , 2011 .

[23]  Erik A. Lewis,et al.  RESEARCH ARTICLE A Nonparametric EM algorithm for Multiscale Hawkes Processes , 2011 .

[24]  A. Stomakhin,et al.  Reconstruction of missing data in social networks based on temporal patterns of interactions , 2011 .

[25]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[26]  Rachel A. Hegemann,et al.  An “Estimate & Score Algorithm” for simultaneous parameter estimation and reconstruction of missing data on social networks , 2012 .

[27]  Hongyuan Zha,et al.  Dyadic event attribution in social networks with mixtures of hawkes processes , 2013, CIKM.

[28]  Le Song,et al.  Learning Social Infectivity in Sparse Low-rank Networks Using Multi-dimensional Hawkes Processes , 2013, AISTATS.

[29]  Shuang-Hong Yang,et al.  Mixture of Mutually Exciting Processes for Viral Diffusion , 2013, ICML.

[30]  Le Song,et al.  Learning Triggering Kernels for Multi-dimensional Hawkes Processes , 2013, ICML.

[31]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[32]  Aram Galstyan,et al.  Latent self-exciting point process model for spatial-temporal networks , 2014 .

[33]  E. Bacry,et al.  Hawkes Processes in Finance , 2015, 1502.04592.

[34]  Le Song,et al.  Dirichlet-Hawkes Processes with Applications to Clustering Continuous-Time Document Streams , 2015, KDD.

[35]  Shuai Gao,et al.  Modeling and Predicting Retweeting Dynamics on Microblogging Platforms , 2015, WSDM.

[36]  Vinayak A. Rao,et al.  A Multitask Point Process Predictive Model , 2015, ICML.

[37]  C. Rudin,et al.  Reactive point processes: A new approach to predicting power failures in underground electrical systems , 2015, 1505.07661.

[38]  Jure Leskovec,et al.  SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularity , 2015, KDD.

[39]  Wenjun Zhang,et al.  Multi-Task Multi-Dimensional Hawkes Processes for Modeling Event Sequences , 2015, IJCAI.

[40]  Hongyuan Zha,et al.  Learning Granger Causality for Hawkes Processes , 2016, ICML.

[41]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[42]  Jimeng Sun,et al.  RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism , 2016, NIPS.

[43]  R. Dahlhaus,et al.  Graphical Modeling for Multivariate Hawkes Processes with Nonparametric Link Functions , 2016, 1605.06759.

[44]  Le Song,et al.  Linking Micro Event History to Macro Prediction in Point Process Models , 2017, AISTATS.

[45]  Le Song,et al.  Wasserstein Learning of Deep Generative Point Process Models , 2017, NIPS.

[46]  Xueqi Cheng,et al.  Cascade Dynamics Modeling with Attention-based Recurrent Neural Network , 2017, IJCAI.

[47]  Hongyuan Zha,et al.  Modeling the Intensity Function of Point Process Via Recurrent Neural Networks , 2017, AAAI.

[48]  Hongyuan Zha,et al.  Learning Hawkes Processes from Short Doubly-Censored Event Sequences , 2017, ICML.

[49]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[50]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[51]  Hongyuan Zha,et al.  A Dirichlet Mixture Model of Hawkes Processes for Event Sequence Clustering , 2017, NIPS.

[52]  Le Song,et al.  Learning Conditional Generative Models for Temporal Point Processes , 2018, AAAI.

[53]  A. Hawkes Hawkes processes and their applications to finance: a review , 2018 .