Uncertainty Quantification for Inferring Hawkes Networks

Multivariate Hawkes processes are commonly used to model streaming networked event data in a wide variety of applications. However, it remains a challenge to extract reliable inference from complex datasets with uncertainty quantification. Aiming towards this, we develop a statistical inference framework to learn causal relationships between nodes from networked data, where the underlying directed graph implies Granger causality. We provide uncertainty quantification for the maximum likelihood estimate of the network multivariate Hawkes process by providing a non-asymptotic confidence set. The main technique is based on the concentration inequalities of continuous-time martingales. We compare our method to the previously-derived asymptotic Hawkes process confidence interval, and demonstrate the strengths of our method in an application to neuronal connectivity reconstruction.

[1]  Mason A. Porter,et al.  Multivariate Spatiotemporal Hawkes Processes and Network Reconstruction , 2018, SIAM J. Math. Data Sci..

[2]  Jure Leskovec,et al.  Community Structure in Large Networks: Natural Cluster Sizes and the Absence of Large Well-Defined Clusters , 2008, Internet Math..

[3]  Emmanuel Bacry,et al.  Second order statistics characterization of Hawkes processes and non-parametric estimation , 2014, 1401.0903.

[4]  Matthias Grossglauser,et al.  Learning Hawkes Processes from a Handful of Events , 2019, NeurIPS.

[5]  Michael L. Hines,et al.  The NEURON Book , 2006 .

[6]  Jon D. McAuliffe,et al.  Time-uniform Chernoff bounds via nonnegative supermartingales , 2018, Probability Surveys.

[7]  Jon D. McAuliffe,et al.  Time-uniform, nonparametric, nonasymptotic confidence sequences , 2018, The Annals of Statistics.

[8]  Xingjian Wang,et al.  Uncertainty Quantification of Flame Transfer Function under a Bayesian Framework , 2018 .

[9]  Shuang Li,et al.  Detecting Changes in Dynamic Events Over Networks , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[10]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[11]  Yao Xie,et al.  Convex Parameter Recovery for Interacting Marked Processes , 2020, IEEE Journal on Selected Areas in Information Theory.

[12]  Gabriel Huerta,et al.  Uncertainty Quantification in Climate Modeling and Projection , 2016 .

[13]  Alex Reinhart,et al.  A Review of Self-Exciting Spatio-Temporal Point Processes and Their Applications , 2017, Statistical Science.

[14]  Yao Xie,et al.  Convex Recovery of Marked Spatio-Temporal Point Processes , 2020, ArXiv.

[15]  Y. Ogata.  The asymptotic behaviour of maximum likelihood estimators for stationary point processes , 1978 .

[16]  Katsunori Kitano,et al.  Reconstructing neuronal circuitry from parallel spike trains , 2018, Nature Communications.

[17]  Emmanuel Bacry,et al.  Uncovering Causality from Multivariate Hawkes Integrated Cumulants , 2016, ICML.

[18]  Vincent Rivoirard,et al.  Inference of functional connectivity in Neurosciences via Hawkes processes , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[19]  Tomasz Kusmierczyk,et al.  On the Causal Effect of Badges , 2018, WWW.

[20]  A. R. Barron,et al.  Adaptive estimation of the intensity of inhomogeneous Poisson processes via concentration inequalities , 2003 .

[21]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[22]  P. Reynaud-Bouret,et al.  Some non asymptotic tail estimates for Hawkes processes , 2007 .

[23]  Jon D. McAuliffe,et al.  Uniform, nonparametric, non-asymptotic confidence sequences , 2018 .

[24]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. , 2005, Journal of neurophysiology.

[25]  J. Rasmussen.  Bayesian Inference for Hawkes Processes , 2013 .

[26]  Swapnil Mishra,et al.  SIR-Hawkes: Linking Epidemic Models and Hawkes Processes to Model Diffusions in Finite Populations , 2017, WWW.

[27]  Hongyuan Zha,et al.  Learning Granger Causality for Hawkes Processes , 2016, ICML.

[28]  Ralph C. Smith,et al.  Uncertainty Quantification: Theory, Implementation, and Applications , 2013 .

[29]  Mingzhou Ding,et al.  Analyzing coherent brain networks with Granger causality , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  R. Dahlhaus,et al.  Graphical Modeling for Multivariate Hawkes Processes with Nonparametric Link Functions , 2016, 1605.06759.

[31]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[32]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .