State Variable Effects in Graphical Event Models

Many real-world domains involve co-evolving relationships between events, such as meals and exercise, and time-varying random variables, such as a patient’s blood glucose levels. In this paper, we propose a general framework for modeling joint temporal dynamics involving continuous time transitions of discrete state variables and irregular arrivals of events over the timeline. We show how conditional Markov processes (as represented by continuous time Bayesian networks) and multivariate point processes (as represented by graphical event models) are among various processes that are covered by the framework. We introduce and compare two simple and interpretable yet practical joint models within the framework with relevant baselines on simulated and real-world datasets, using a graph search algorithm for learning. The experiments highlight the importance of jointly modeling event arrivals and state variable transitions to better fit joint temporal datasets, and the framework opens up possibilities for models involving even more complex dynamics whenever suitable.

[1]  Larry A. Wasserman,et al.  Time varying undirected graphs , 2008, Machine Learning.

[2]  Daphne Koller,et al.  Learning Continuous Time Bayesian Networks , 2002, UAI.

[3]  Thore Graepel,et al.  Poisson-Networks: A Model for Structured Poisson Processes. , 2005 .

[4]  Tian Gao,et al.  Proximal Graphical Event Models , 2018, NeurIPS.

[5]  Michael Eichler,et al.  Graphical Models in Time Series Analysis , 1999 .

[6]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[7]  Karthikeyan Shanmugam,et al.  A Multi-Channel Neural Graphical Event Model with Negative Evidence , 2020, AAAI.

[8]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[9]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[10]  Le Song,et al.  Estimating time-varying networks , 2008, ISMB 2008.

[11]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[12]  Christopher Meek Toward Learning Graphical and Causal Process Models , 2014, CI@UAI.

[13]  Christos Faloutsos,et al.  Edge Weight Prediction in Weighted Signed Networks , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[14]  Hongyuan Zha,et al.  Modeling the Intensity Function of Point Process Via Recurrent Neural Networks , 2017, AAAI.

[15]  Karthikeyan Shanmugam,et al.  Event-Driven Continuous Time Bayesian Networks: An Application in Modeling Progression out of Poverty through Integrated Social Services , 2019 .

[16]  Vanessa Didelez,et al.  Graphical models for marked point processes based on local independence , 2007, 0710.5874.

[17]  Puyang Xu,et al.  A Model for Temporal Dependencies in Event Streams , 2011, NIPS.

[18]  Daphne Koller,et al.  Continuous Time Bayesian Networks , 2012, UAI.

[19]  Gavin Smith,et al.  Event Series Prediction via Non-Homogeneous Poisson Process Modelling , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[20]  P. A. W. Lewis,et al.  Multivariate point processes , 2018, Point Processes.

[21]  Jure Leskovec,et al.  {SNAP Datasets}: {Stanford} Large Network Dataset Collection , 2014 .

[22]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[23]  Michael I. Jordan,et al.  Modeling Events with Cascades of Poisson Processes , 2010, UAI.

[24]  Vince D. Calhoun,et al.  Rate-Agnostic (Causal) Structure Learning , 2015, NIPS.

[25]  Christopher Meek,et al.  Universal Models of Multivariate Temporal Point Processes , 2016, AISTATS.

[26]  Kush R. Varshney,et al.  Event-Driven Continuous Time Bayesian Networks , 2020, AAAI.