Decoupled Learning for Factorial Marked Temporal Point Processes

This paper presents a factorial marked temporal point process model and presents efficient learning methods. In conventional (multi-dimensional) marked temporal point process models, an event is often encoded by a single discrete variable (marker). We describe the factorial marked point processes whereby time-stamped event is factored into multiple markers. Accordingly the size of the infectivity matrix modeling the effect between pairwise markers is in exponential order regarding the number of discrete markers. We propose a decoupled learning method with two learning procedures: i) directly solving the model based on two techniques: Alternating Direction Method of Multipliers and Fast Iterative Shrinkage-Thresholding Algorithm; ii) involving a reformulation that transforms the original problem into a Logistic Regression model for more efficient learning. Moreover, a sparse group regularizer is added to identify the key profile features and event labels. Empirical results on real world datasets demonstrate the efficiency of our decoupled and reformulated method.

[1]  Le Song,et al.  Time-Sensitive Recommendation From Recurrent User Activities , 2015, NIPS.

[2]  Y. Ogata Space-Time Point-Process Models for Earthquake Occurrences , 1998 .

[3]  Le Song,et al.  Learning Social Infectivity in Sparse Low-rank Networks Using Multi-dimensional Hawkes Processes , 2013, AISTATS.

[4]  Noah Simon,et al.  A Sparse-Group Lasso , 2013 .

[5]  Hongyuan Zha,et al.  Learning Parametric Models for Social Infectivity in Multi-Dimensional Hawkes Processes , 2014, AAAI.

[6]  Yosihiko Ogata,et al.  Statistical Models for Earthquake Occurrences and Residual Analysis for Point Processes , 1988 .

[7]  P. Bühlmann,et al.  The group lasso for logistic regression , 2008 .

[8]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[9]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[10]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[11]  V. Isham,et al.  A self-correcting point process , 1979 .

[12]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[13]  Stephen J. Roberts,et al.  Variational Inference for Gaussian Process Modulated Poisson Processes , 2014, ICML.

[14]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[15]  T. Ozaki Maximum likelihood estimation of Hawkes' self-exciting point processes , 1979 .

[16]  Michael I. Jordan,et al.  Factorial Hidden Markov Models , 1995, Machine Learning.

[17]  Erik A. Lewis,et al.  RESEARCH ARTICLE A Nonparametric EM algorithm for Multiscale Hawkes Processes , 2011 .

[18]  Esko Valkeila,et al.  An Introduction to the Theory of Point Processes, Volume II: General Theory and Structure, 2nd Edition by Daryl J. Daley, David Vere‐Jones , 2008 .

[19]  Hongyuan Zha,et al.  Modeling the Intensity Function of Point Process Via Recurrent Neural Networks , 2017, AAAI.

[20]  Pranab Kumar Sen,et al.  Nonparametrics: Retrospectives and perspectives , 1991 .

[21]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[22]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[23]  Le Song,et al.  Learning Triggering Kernels for Multi-dimensional Hawkes Processes , 2013, ICML.

[24]  Hongyuan Zha,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Towards Effective Prioritizing Water Pipe Replacement and Rehabilitation ∗ , 2022 .

[25]  Shamim Nemati,et al.  Patient Flow Prediction via Discriminative Learning of Mutually-Correcting Processes , 2016, IEEE Transactions on Knowledge and Data Engineering.

[26]  A. Gelfand,et al.  Handbook of spatial statistics , 2010 .

[27]  Thomas Josef Liniger,et al.  Multivariate Hawkes processes , 2009 .