Neural Causality Detection for Multi-dimensional Point Processes

In the big data era, while correlation detection is relatively straightforward and successfully addressed by many techniques, causality detection does not have a generally-used solution. Causality provides valuable insights into data and guides further studies. With the overall assumption that causal influence can only be from prior history events, time plays an essential part in causality analysis, and this important feature means the data with strict temporal structure needs to be modelled. Traditionally, temporal point processes are employed to model data containing temporal structure information. The heuristic parameterization property of such models makes the task difficult. Domain related knowledge are needed to design proper parameterization. Recently, Recurrent Neural Networks (RNNs) have been used for time-related data modelling. RNN’s trainable parameterization considerably reduces the dependency on domain-related knowledge. In this work, we show that combining neural network techniques with Granger causality framework has great potential by presenting an RNN model integrated with a Granger causality framework. The experimental results show that the same network structure can be applied to a variety of datasets and causalities are detected successfully.

[1]  Emery N. Brown,et al.  A Granger Causality Measure for Point Process Models of Ensemble Neural Spiking Activity , 2011, PLoS Comput. Biol..

[2]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[3]  G. Rangarajan,et al.  Multiple Nonlinear Time Series with Extended Granger Causality , 2004 .

[4]  Daniele Marinazzo,et al.  Kernel method for nonlinear granger causality. , 2007, Physical review letters.

[5]  Yosihiko Ogata,et al.  Statistical Models for Earthquake Occurrences and Residual Analysis for Point Processes , 1988 .

[6]  E. Bacry,et al.  Some limit theorems for Hawkes processes and application to financial statistics , 2013 .

[7]  Daniele Marinazzo,et al.  Radial basis function approach to nonlinear Granger causality of time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Ioane Muni Toke,et al.  An Introduction to Hawkes Processes with Applications to Finance , 2011 .

[9]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[10]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[11]  W. Singer,et al.  Testing non-linearity and directedness of interactions between neural groups in the macaque inferotemporal cortex , 1999, Journal of Neuroscience Methods.

[12]  Daniele Marinazzo,et al.  Nonlinear parametric model for Granger causality of time series , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Thomas Josef Liniger,et al.  Multivariate Hawkes processes , 2009 .