Deep Mixture Point Processes: Spatio-temporal Event Prediction with Rich Contextual Information

Predicting when and where events will occur in cities, like taxi pick-ups, crimes, and vehicle collisions, is a challenging and important problem with many applications in fields such as urban planning, transportation optimization and location-based marketing. Though many point processes have been proposed to model events in a continuous spatio-temporal space, none of them allow for the consideration of the rich contextual factors that affect event occurrence, such as weather, social activities, geographical characteristics, and traffic. In this paper, we propose DMPP (Deep Mixture Point Processes), a point process model for predicting spatio-temporal events with the use of rich contextual information; a key advance is its incorporation of the heterogeneous and high-dimensional context available in image and text data. Specifically, we design the intensity of our point process model as a mixture of kernels, where the mixture weights are modeled by a deep neural network. This formulation allows us to automatically learn the complex nonlinear effects of the contextual factors on event occurrence. At the same time, this formulation makes analytical integration over the intensity, which is required for point process estimation, tractable. We use real-world data sets from different domains to demonstrate that DMPP has better predictive performance than existing methods.

[1]  E. Bacry,et al.  Hawkes Processes in Finance , 2015, 1502.04592.

[2]  Marc Hoffmann,et al.  A recursive point process model for infectious diseases , 2017, Annals of the Institute of Statistical Mathematics.

[3]  D.,et al.  Regression Models and Life-Tables , 2022 .

[4]  Pengfei Wang,et al.  Human Mobility Synchronization and Trip Purpose Detection with Mixture of Hawkes Processes , 2017, KDD.

[5]  B. Sansó,et al.  A Spatio-Temporal Model for Mean, Anomaly, and Trend Fields of North Atlantic Sea Surface Temperature , 2009 .

[6]  Yacine Ait-Sahalia,et al.  Modeling Financial Contagion Using Mutually Exciting Jump Processes , 2010 .

[7]  Zhaohui Wu,et al.  Dynamic cluster-based over-demand prediction in bike sharing systems , 2016, UbiComp.

[8]  Y. Ogata Space-Time Point-Process Models for Earthquake Occurrences , 1998 .

[9]  Hongbo Deng,et al.  Identifying and labeling search tasks via query-based hawkes processes , 2014, KDD.

[10]  Yong Gao,et al.  Understanding Urban Traffic-Flow Characteristics: A Rethinking of Betweenness Centrality , 2013 .

[11]  Hongyuan Zha,et al.  Modeling the Intensity Function of Point Process Via Recurrent Neural Networks , 2017, AAAI.

[12]  Ambuj K. Singh,et al.  FCCF: forecasting citywide crowd flows based on big data , 2016, SIGSPATIAL/GIS.

[13]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[14]  Tomoharu Iwata,et al.  Discovering latent influence in online social activities via shared cascade poisson processes , 2013, KDD.

[15]  Zhoujun Li,et al.  Citywide traffic congestion estimation with social media , 2015, SIGSPATIAL/GIS.

[16]  G. Shedler,et al.  Simulation of Nonhomogeneous Poisson Processes by Thinning , 1979 .

[17]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[18]  Peter J. Diggle,et al.  Spatial and spatio-temporal Log-Gaussian Cox processes:extending the geostatistical paradigm , 2013, 1312.6536.

[19]  C. Rudin,et al.  Reactive point processes: A new approach to predicting power failures in underground electrical systems , 2015, 1505.07661.

[20]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[21]  Le Song,et al.  Shaping Social Activity by Incentivizing Users , 2014, NIPS.

[22]  Lixin Gao,et al.  Road traffic prediction by incorporating online information , 2014, WWW '14 Companion.

[23]  Richard Socher,et al.  Knowing When to Look: Adaptive Attention via a Visual Sentinel for Image Captioning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Le Song,et al.  Constructing Disease Network and Temporal Progression Model via Context-Sensitive Hawkes Process , 2015, 2015 IEEE International Conference on Data Mining.

[25]  David Higdon,et al.  Inference for a Proton Accelerator Using Convolution Models , 2008 .

[26]  Gentry White,et al.  Self-exciting hurdle models for terrorist activity , 2012, 1203.3680.

[27]  Le Song,et al.  Wasserstein Learning of Deep Generative Point Process Models , 2017, NIPS.

[28]  Patricia L. Brantingham,et al.  Mobility, Notoriety, and Crime: A Study in the Crime Patterns of Urban Nodal Points , 1981 .

[29]  D. Higdon Space and Space-Time Modeling using Process Convolutions , 2002 .

[30]  Bowen Zhou,et al.  A Structured Self-attentive Sentence Embedding , 2017, ICLR.

[31]  George E. Tita,et al.  Self-Exciting Point Process Modeling of Crime , 2011 .

[32]  Holger Wendland,et al.  Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree , 1995, Adv. Comput. Math..

[33]  Jorge Mateu,et al.  Spatio-temporal log-Gaussian Cox processes for modelling wildfire occurrence: the case of Catalonia, 1994–2008 , 2014, Environmental and Ecological Statistics.

[34]  Kenta Oono,et al.  Chainer : a Next-Generation Open Source Framework for Deep Learning , 2015 .

[35]  Peter J. Diggle,et al.  lgcp: An R Package for Inference with Spatial and Spatio-Temporal Log-Gaussian Cox Processes , 2013 .

[36]  Masamichi Shimosaka,et al.  Forecasting urban dynamics with mobility logs by bilinear Poisson regression , 2015, UbiComp.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[39]  Catherine Quantin,et al.  A relative survival regression model using B‐spline functions to model non‐proportional hazards , 2003, Statistics in medicine.

[40]  Zbigniew R. Struzik,et al.  Increased Non-Gaussianity of Heart Rate Variability Predicts Cardiac Mortality after an Acute Myocardial Infarction , 2011, Front. Physio..