Ordinal Historical Dependence in Graphical Event Models with Tree Representations

Graphical event models are representations that capture process independence between different types of events in multivariate temporal point processes. The literature consists of various parametric models and approaches to learn them from multivariate event stream data. Since these models are interpretable, they are often able to provide beneficial insights about event dynamics. In this paper, we show how to compactly model the situation where the order of occurrences of an event’s causes in some recent historical time interval impacts its occurrence rate; this sort of historical dependence is common in several real-world applications. To overcome the practical challenge of parameter explosion due to the number of potential orders that is super-exponential in the number of parents, we introduce a novel graphical event model based on a parametric tree representation for capturing ordinal historical dependence. We present an approach to learn such a model from data, demonstrating that the proposed model fits several real-world datasets better than relevant baselines. We also showcase the potential advantages of such a model to an analyst during the process of knowledge discovery.

[1]  David Heckerman,et al.  Knowledge Representation and Inference in Similarity Networks and Bayesian Multinets , 1996, Artif. Intell..

[2]  M. Saeed,et al.  Multiparameter Intelligent Monitoring in Intensive Care Ii (Mimic-Ii): A Public-Access Intensive Care Unit Database , 2011 .

[3]  Scott Grant,et al.  Encouraging user behaviour with achievements: An empirical study , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[4]  O. Aalen,et al.  Survival and Event History Analysis: A Process Point of View , 2008 .

[5]  Emmanuel Bacry,et al.  tick: a Python Library for Statistical Learning, with an emphasis on Hawkes Processes and Time-Dependent Models , 2017, J. Mach. Learn. Res..

[6]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[7]  Craig Boutilier,et al.  Context-Specific Independence in Bayesian Networks , 1996, UAI.

[8]  Nevin Lianwen Zhang,et al.  Exploiting Contextual Independence In Probabilistic Inference , 2011, J. Artif. Intell. Res..

[9]  Wenjun Zhang,et al.  Multi-Task Multi-Dimensional Hawkes Processes for Modeling Event Sequences , 2015, IJCAI.

[10]  E. Bacry,et al.  Hawkes Processes in Finance , 2015, 1502.04592.

[11]  Christopher Meek.  Toward Learning Graphical and Causal Process Models , 2014, CI@UAI.

[12]  Daphne Koller,et al.  Learning Continuous Time Bayesian Networks , 2002, UAI.

[13]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[14]  Ankur Parikh,et al.  Conjoint Modeling of Temporal Dependencies in Event Streams , 2012, BMA.

[15]  Debarun Bhattacharjya,et al.  Order-Dependent Event Models for Agent Interactions , 2020, IJCAI.

[16]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[17]  Sean P. O'Brien,et al.  Crisis Early Warning and Decision Support: Contemporary Approaches and Thoughts on Future Research , 2010 .

[18]  Hongyuan Zha,et al.  Learning Hawkes Processes from Short Doubly-Censored Event Sequences , 2017, ICML.

[19]  P. A. W. Lewis,et al.  Multivariate point processes , 2018, Point Processes.

[20]  Karthikeyan Shanmugam,et al.  Hawkesian Graphical Event Models , 2020, PGM.

[21]  Kun Zhang,et al.  Learning Network of Multivariate Hawkes Processes: A Time Series Approach , 2016, UAI.

[22]  Vanessa Didelez,et al.  Graphical models for marked point processes based on local independence , 2007, 0710.5874.

[23]  Hongyuan Zha,et al.  Modeling the Intensity Function of Point Process Via Recurrent Neural Networks , 2017, AAAI.

[24]  Tian Gao,et al.  Proximal Graphical Event Models , 2018, NeurIPS.

[25]  Karthikeyan Shanmugam,et al.  A Multi-Channel Neural Graphical Event Model with Negative Evidence , 2020, AAAI.

[26]  Richard Mortier,et al.  CT-NOR: Representing and Reasoning About Events in Continuous Time , 2008, UAI.

[27]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[28]  Puyang Xu,et al.  A Model for Temporal Dependencies in Event Streams , 2011, NIPS.