Transfer Entropy for Nonparametric Granger Causality Detection: An Evaluation of Different Resampling Methods

The information-theoretical concept transfer entropy is an ideal measure for detecting conditional independence, or Granger causality in a time series setting. The recent literature indeed witnesses an increased interest in applications of entropy-based tests in this direction. However, those tests are typically based on nonparametric entropy estimates for which the development of formal asymptotic theory turns out to be challenging. In this paper, we provide numerical comparisons for simulation-based tests to gain some insights into the statistical behavior of nonparametric transfer entropy-based tests. In particular, surrogate algorithms and smoothed bootstrap procedures are described and compared. We conclude this paper with a financial application to the detection of spillover effects in the global equity market.

[1]  C. Diks,et al.  Assessment of Resampling Methods for Causality Testing , 2014 .

[2]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[3]  F. Diebold,et al.  Measuring Financial Asset Return and Volatility Spillovers, with Application to Global Equity Markets , 2008 .

[4]  R Quian Quiroga,et al.  Performance of different synchronization measures in real data: a case study on electroencephalographic signals. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Dimitris Kugiumtzis,et al.  Simulation Study of Direct Causality Measures in Multivariate Time Series , 2013, Entropy.

[6]  E. Maasoumi,et al.  A Dependence Metric for Possibly Nonlinear Processes , 2004 .

[7]  M. Hinich,et al.  Detecting Nonlinearity in Time Series: Surrogate and Bootstrap Approaches , 2005 .

[8]  R. Moddemeijer.  On estimation of entropy and mutual information of continuous distributions , 1989 .

[9]  Cees Diks,et al.  Tests for Serial Independence and Linearity Based on Correlation Integrals , 2002 .

[10]  H. Joe.  Estimation of entropy and other functionals of a multivariate density , 1989 .

[11]  M. C. Jones,et al.  A Brief Survey of Bandwidth Selection for Density Estimation , 1996 .

[12]  J. Cochran.  What is the bootstrap? , 2019, Significance.

[13]  B. Efron.  Computers and the Theory of Statistics: Thinking the Unthinkable , 1979 .

[14]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[15]  C. Granger,et al.  USING THE MUTUAL INFORMATION COEFFICIENT TO IDENTIFY LAGS IN NONLINEAR MODELS , 1994 .

[16]  Jose E. Gomez-Gonzalez,et al.  Volatility spillovers among global stock markets: measuring total and directional effects , 2017 .

[17]  H. Kantz,et al.  Analysing the information flow between financial time series , 2002 .

[18]  C. Granger,et al.  Co-integration and error correction: representation, estimation and testing , 1987 .

[19]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[20]  M. Chavance.  [Jackknife and bootstrap]. , 1992, Revue d'epidemiologie et de sante publique.

[21]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[22]  Craig Hiemstra,et al.  Testing for Linear and Nonlinear Granger Causality in the Stock Price-Volume Relation , 1994 .

[23]  T. Bossomaier,et al.  Transfer entropy as a log-likelihood ratio. , 2012, Physical review letters.

[24]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[25]  Aaron D. Wyner,et al.  Prediction and Entropy of Printed English , 1993 .

[26]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[27]  H. White,et al.  A NONPARAMETRIC HELLINGER METRIC TEST FOR CONDITIONAL INDEPENDENCE , 2008, Econometric Theory.

[28]  H. White,et al.  Testing Conditional Independence Via Empirical Likelihood , 2014 .

[29]  Luca Faes,et al.  Mutual nonlinear prediction as a tool to evaluate coupling strength and directionality in bivariate time series: comparison among different strategies based on k nearest neighbors. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  James Davidson,et al.  Establishing conditions for the functional central limit theorem in nonlinear and semiparametric time series processes , 2002 .

[31]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[32]  Dimitris Kugiumtzis,et al.  Evaluation of Surrogate and Bootstrap Tests for Nonlinearity in Time Series , 2008 .

[33]  Joseph P. Romano,et al.  The stationary bootstrap , 1994 .

[34]  Efstathios Paparoditis,et al.  On bootstrapping L2-type statistics in density testing , 2000 .

[35]  J. Rombouts,et al.  Nonparametric Copula-Based Test for Conditional Independence with Applications to Granger Causality , 2012 .

[36]  Efstathios Paparoditis,et al.  The Local Bootstrap for Kernel Estimators under General Dependence Conditions , 2000 .

[37]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[38]  James Nga-Kwok Liu,et al.  Optimal bandwidth selection for re-substitution entropy estimation , 2012, Appl. Math. Comput..

[39]  C. Diks,et al.  Detecting Granger Causality with a Nonparametric Information-based Statistic , 2016 .

[40]  Measuring Financial Asset Return and Volatility Spillovers, with Application to Global Equity Markets , 2008 .

[41]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[42]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[43]  P. Robinson.  Consistent Nonparametric Entropy-Based Testing , 1991 .

[44]  Vasily A. Vakorin,et al.  Confounding effects of indirect connections on causality estimation , 2009, Journal of Neuroscience Methods.

[45]  Dimitris Kugiumtzis,et al.  Assessment of resampling methods for causality testing: A note on the US inflation behavior , 2017, PloS one.

[46]  Dimitris Kugiumtzis,et al.  Direct coupling information measure from non-uniform embedding , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Cees Diks,et al.  A new statistic and practical guidelines for nonparametric Granger causality testing , 2006 .

[48]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Olivier J. J. Michel,et al.  The relation between Granger causality and directed information theory: a review , 2012, Entropy.

[50]  C. Diks,et al.  The nonlinear dynamic relationship of exchange rates: Parametric and nonparametric causality testing , 2008 .

[51]  H. White,et al.  ASYMPTOTIC DISTRIBUTION THEORY FOR NONPARAMETRIC ENTROPY MEASURES OF SERIAL DEPENDENCE , 2005 .

[52]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .