Spatiotemporal Sequence Prediction With Point Processes and Self-Organizing Decision Trees

We investigate spatio-temporal prediction and introduce a novel prediction algorithm. Our approach is based on the point processes, which we use to model the event arrivals in both space and time. Although we specifically use the Hawkes process, other processes can be readily used as provided remarks in the paper. Moreover, we partition the given spatial region into subregions by an adaptive decision tree and model each subregion with individual and interacting point processes. With individual point processes for each subregion, we estimate the time and location of the events using the past event times and locations. Furthermore, thanks to the nonstationary and self-exciting point generation mechanism in the Hawkes process and the adaptive partitioning of the space, we model the data as nonstationary in both time and space. Finally, we provide a gradient based joint optimization algorithm for the adaptive tree parameter and the point process parameters. With the joint optimization, our algorithm can infer the source statistics and adaptive partitioning of the region. We also provide a training algorithm for the online setup, where we update the model parameters with newly arrived points. We provide experimental results on both simulated data and real-life data where we compare our approach with the standard approaches and demonstrate significant performance improvements thanks to the adaptive spatial partitioning mechanism and the joint optimization procedure.

[1]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[2]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[3]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[4]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[5]  R. Caflisch.  Monte Carlo and quasi-Monte Carlo methods , 1998, Acta Numerica.

[6]  George E. Tita,et al.  Self-Exciting Point Process Modeling of Crime , 2011 .

[7]  Yunpeng Wang,et al.  Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks , 2017, Sensors.

[8]  Abbas Khosravi,et al.  A Survey of Computational Intelligence Techniques for Wind Power Uncertainty Quantification in Smart Grids , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Erik A. Lewis,et al.  RESEARCH ARTICLE A Nonparametric EM algorithm for Multiscale Hawkes Processes , 2011 .

[10]  V. Isham,et al.  A self-correcting point process , 1979 .

[11]  M. Schlather.  Point Process Theory and Applications: Marked Point and Piecewise Deterministic Processes , 2007 .

[12]  Cesare Alippi,et al.  A Self-Building and Cluster-Based Cognitive Fault Diagnosis System for Sensor Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Jianyong Wang,et al.  Social Link Inference via Multiview Matching Network From Spatiotemporal Trajectories , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Andrea L. Bertozzi,et al.  Graph-Based Deep Modeling and Real Time Forecasting of Sparse Spatio-Temporal Data , 2018, ArXiv.

[16]  Vito Roberto,et al.  Seismic signal understanding: a knowledge-based recognition system , 1992, IEEE Trans. Signal Process..

[17]  Jack Xin,et al.  Deep Learning for Real-Time Crime Forecasting and Its Ternarization , 2017, Chinese Annals of Mathematics, Series B.

[18]  Le Song,et al.  Isotonic Hawkes Processes , 2016, ICML.

[19]  Esko Valkeila,et al.  An Introduction to the Theory of Point Processes, Volume II: General Theory and Structure, 2nd Edition by Daryl J. Daley, David Vere‐Jones , 2008 .

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  David Vere-Jones,et al.  Point Processes , 2011, International Encyclopedia of Statistical Science.

[22]  Frans M. J. Willems,et al.  The context-tree weighting method: basic properties , 1995, IEEE Trans. Inf. Theory.

[23]  Xinmin Wang,et al.  EEG-Based Spatio–Temporal Convolutional Neural Network for Driver Fatigue Evaluation , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Yosihiko Ogata,et al.  On Lewis' simulation method for point processes , 1981, IEEE Trans. Inf. Theory.

[25]  I. Maqsood,et al.  Random Forests and Decision Trees , 2012 .

[26]  Hiroo Kanamori,et al.  Earthquake Prediction: An Overview , 2003 .

[27]  William H. Press,et al.  Numerical recipes in C , 2002 .

[28]  Ying Cai,et al.  Recurrent Spatio-Temporal Point Process for Check-in Time Prediction , 2018, CIKM.

[29]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[30]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[31]  Tao Hu,et al.  Deep Convolutional Neural Networks for Spatiotemporal Crime Prediction , 2017 .

[32]  Jing Wang,et al.  Spatiotemporal modeling and prediction in cellular networks: A big data enabled deep learning approach , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[33]  Duo Zhang,et al.  Deep Learning for Real Time Crime Forecasting , 2017, ArXiv.

[34]  Botond Cseke,et al.  Sparse Approximate Inference for Spatio-Temporal Point Process Models , 2013, 1305.4152.

[35]  Tie Qiu,et al.  Spatio-Temporal Interpolated Echo State Network for Meteorological Series Prediction , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Tao Cheng,et al.  Novel evaluation metrics for sparse spatio-temporal point process hotspot predictions - a crime case study , 2016, Int. J. Geogr. Inf. Sci..