Truncated Hawkes point process modeling: System theory and system identification

Abstract Point processes have a growing list of applications, including, neuroscience, high frequency finance, genomics and more recently, streaming data. Perhaps the most used parameterized dynamic (aka self-exciting i.e. history dependent) model is the (linear) Hawkes model. But the Hawkes model assumes the infinite past is available and has to be truncated for empirical use. Here we develop, for the first time, the system theory for the truncated Hawkes process. This includes: necessary and sufficient conditions for stability; a Wold decomposition; and an asymptotic spectrum. We then discuss various parameterizations (Exponential, Laguerre, Binomial-autoregression) and their properties. Using the Laguerre parameterization, we next develop a new continuous time multiplicative EM algorithm for maximum likelihood estimation and develop some of its properties. It turns out that the multiplicative EM algorithm does not guarantee stability and so we develop a modified multiplicative EM that does. We also derive, for the first time for self-exciting processes, the Cramer–Rao bound as well as a BIC model selection criterion. We illustrate with simulations, comparing the Laguerre approach to the popular binomial-autoregression and then with an application to neural data recorded from a cat’s brain under visual stimuli.

[1]  Hiroyuki Mino,et al.  Parameter estimation of the intensity process of self-exciting point processes using the EM algorithm , 2001, IEEE Trans. Instrum. Meas..

[2]  Walter Zucchini,et al.  Model Selection , 2011, International Encyclopedia of Statistical Science.

[3]  Niels Keiding,et al.  Statistical Models Based on Counting Processes , 1993 .

[4]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[5]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[6]  A. Hawkes.  Spectra of some self-exciting and mutually exciting point processes , 1971 .

[7]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[8]  L. Lucy.  An iterative technique for the rectification of observed distributions , 1974 .

[9]  Victor Solo,et al.  Point-Process Principal Components Analysis via Geometric Optimization , 2013, Neural Computation.

[10]  A. Veen,et al.  Estimation of Space–Time Branching Process Models in Seismology Using an EM–Type Algorithm , 2006 .

[11]  K. Åström.  Introduction to Stochastic Control Theory , 1970 .

[12]  G. Shedler,et al.  Simulation of Nonhomogeneous Poisson Processes by Thinning , 1979 .

[13]  Yosihiko Ogata,et al.  On Lewis' simulation method for point processes , 1981, IEEE Trans. Inf. Theory.

[14]  P. Brémaud,et al.  STABILITY OF NONLINEAR HAWKES PROCESSES , 1996 .

[15]  E. S. Chornoboy,et al.  Maximum likelihood identification of neural point process systems , 1988, Biological Cybernetics.

[16]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[17]  Ole Winther,et al.  Multivariate Hawkes process models of the occurrence of regulatory elements , 2010, BMC Bioinformatics.

[18]  Victor Solo,et al.  Intrinsic random functions and the paradox of l/f noise , 1992 .

[19]  P. Reynaud-Bouret,et al.  Adaptive estimation for Hawkes processes; application to genome analysis , 2009, 0903.2919.

[20]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[21]  Patrick J. Wolfe,et al.  Point process modelling for directed interaction networks , 2010, ArXiv.

[22]  P. Brémaud.  Point Processes and Queues , 1981 .

[23]  E. Bacry,et al.  Non-parametric kernel estimation for symmetric Hawkes processes. Application to high frequency financial data , 2011, 1112.1838.

[24]  B. Wahlberg.  System identification using Laguerre models , 1991 .

[25]  Nikolaus Hautsch,et al.  Modelling Irregularly Spaced Financial Data , 2004 .

[26]  Mark Berman,et al.  Approximating Point Process Likelihoods with Glim , 1992 .

[27]  Kathleen M. Carley,et al.  Exact and approximate EM estimation of mutually exciting hawkes processes , 2013 .

[28]  J. McFadden.  The Entropy of a Point Process , 1965 .

[29]  Jonathan W. Pillow,et al.  Likelihood-based approaches to modeling the neural code , 2007 .

[30]  Donald L. Snyder,et al.  Random point processes , 1975 .

[31]  Izhak Rubin,et al.  Regular point processes and their detection , 1972, IEEE Trans. Inf. Theory.

[32]  Yosihiko Ogata,et al.  Statistical Models for Earthquake Occurrences and Residual Analysis for Point Processes , 1988 .

[33]  Pham Dinh Tuan.  Estimation of the Spectral Parameters of a Stationary Point Process , 1981 .