Transfer Information Energy: A Quantitative Indicator of Information Transfer between Time Series

We introduce an information-theoretical approach for analyzing information transfer between time series. Rather than using the Transfer Entropy (TE), we define and apply the Transfer Information Energy (TIE), which is based on Onicescu’s Information Energy. Whereas the TE can be used as a measure of the reduction in uncertainty about one time series given another, the TIE may be viewed as a measure of the increase in certainty about one time series given another. We compare the TIE and the TE in two known time series prediction applications. First, we analyze stock market indexes from the Americas, Asia/Pacific and Europe, with the goal to infer the information transfer between them (i.e., how they influence each other). In the second application, we take a bivariate time series of the breath rate and instantaneous heart rate of a sleeping human suffering from sleep apnea, with the goal to determine the information transfer heart → breath vs. breath → heart. In both applications, the computed TE and TIE values are strongly correlated, meaning that the TIE can substitute the TE for such applications, even if they measure symmetric phenomena. The advantage of using the TIE is computational: we can obtain similar results, but faster.

[1]  Mikhail Prokopenko,et al.  Differentiating information transfer and causal effect , 2008, 0812.4373.

[2]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[3]  G. Moody,et al.  Development of the polysomnographic database on CD‐ROM , 1999, Psychiatry and clinical neurosciences.

[4]  A COMPARISON OF CAUSALITY TESTS APPLIED TO THE BILATERAL RELATIONSHIP BETWEEN CONSUMPTION AND GDP IN THE USA AND MEXICO , 2005 .

[5]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[6]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[7]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[8]  Kateřina Hlaváčková-Schindler,et al.  Causality in Time Series: Its Detection and Quantification by Means of Information Theory , 2009 .

[9]  G. Battail.  Théorie de l'information , 1982, Électronique.

[10]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[11]  Joseph T. Lizier,et al.  An Introduction to Transfer Entropy: Information Flow in Complex Systems , 2016 .

[12]  Okyu Kwon,et al.  Information flow between stock indices , 2008, 0802.1747.

[13]  Aapo Hyvärinen,et al.  Nonlinear Functional Causal Models for Distinguishing Cause from Effect , 2016 .

[14]  A model-free characterization of causality , 2006 .

[15]  T. Dimpfl,et al.  Using transfer entropy to measure information flows between financial markets , 2013 .

[16]  Gabjin Oh,et al.  Asymmetric information flow between market index and individual stocks in several stock markets , 2012 .

[17]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[18]  Monica Borda,et al.  Fundamentals in Information Theory and Coding , 2011 .

[19]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[20]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[21]  Pengjian Shang,et al.  Transfer entropy between multivariate time series , 2017, Commun. Nonlinear Sci. Numer. Simul..

[22]  Andreas S. Weigend,et al.  Multi-Channel Physiological Data: Description and Analysis (Data Set B) , 2018 .

[23]  K. Schindlerova,et al.  Equivalence of Granger Causalityand Transfer Entropy: A Generalization. , 2011 .

[24]  Tshilidzi Marwala,et al.  Causality, Correlation and Artificial Intelligence for Rational Decision Making , 2015 .

[25]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[26]  Angel Cataron,et al.  Transfer Information Energy: A Quantitative Causality Indicator Between Time Series , 2017, ICANN.

[27]  Huazhong Shu,et al.  Contribution to Transfer Entropy Estimation via the k-Nearest-Neighbors Approach , 2015, Entropy.

[28]  Deniz Gençaga,et al.  A Recipe for the Estimation of Information Flow in a Dynamical System , 2015, Entropy.

[29]  Leonidas Sandoval,et al.  Structure of a Global Network of Financial Companies Based on Transfer Entropy , 2014, Entropy.

[30]  T. Schreiber,et al.  Information transfer in continuous processes , 2002 .

[31]  James P. Crutchfield,et al.  Information Flows? A Critique of Transfer Entropies , 2015, Physical review letters.

[32]  Dick E. Boekee,et al.  A generalized class of certainty and information measures , 1982, Inf. Sci..