Detecting Causality from Nonlinear Dynamics with Short-term Time Series

Quantifying causality between variables from observed time series data is of great importance in various disciplines but also a challenging task, especially when the observed data are short. Unlike the conventional methods, we find it possible to detect causality only with very short time series data, based on embedding theory of an attractor for nonlinear dynamics. Specifically, we first show that measuring the smoothness of a cross map between two observed variables can be used to detect a causal relation. Then, we provide a very effective algorithm to computationally evaluate the smoothness of the cross map, or “Cross Map Smoothness” (CMS), and thus to infer the causality, which can achieve high accuracy even with very short time series data. Analysis of both mathematical models from various benchmarks and real data from biological systems validates our method.

[1]  R. Burke,et al.  Detecting dynamical interdependence and generalized synchrony through mutual prediction in a neural ensemble. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[3]  A. N. Sharkovskiĭ.  Dynamic systems and turbulence , 1989 .

[4]  Jianfeng Feng,et al.  Uncovering Interactions in the Frequency Domain , 2008, PLoS Comput. Biol..

[5]  Jörg D. Becker,et al.  LegumeGRN: A Gene Regulatory Network Prediction Server for Functional and Comparative Studies , 2013, PloS one.

[6]  K. Aihara,et al.  Early Diagnosis of Complex Diseases by Molecular Biomarkers, Network Biomarkers, and Dynamical Network Biomarkers , 2014, Medicinal research reviews.

[7]  K. Horimoto,et al.  Phase Shifts of Circadian Transcripts in Rat Suprachiasmatic Nucleus , 2008 .

[8]  Janita Raskala,et al.  Methods and challenges , 2014 .

[9]  Explore Configuring,et al.  A Simulation Study to , 2004 .

[10]  Y. Sakaki,et al.  Establishment of cell lines derived from the rat suprachiasmatic nucleus. , 2007, Biochemical and biophysical research communications.

[11]  Jianfeng Feng,et al.  Granger causality with signal-dependent noise , 2011, NeuroImage.

[12]  Daniel Chicharro,et al.  Reliable detection of directional couplings using rank statistics. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Xiang-Sun Zhang,et al.  A network biology study on circadian rhythm by integrating various omics data. , 2009, Omics : a journal of integrative biology.

[14]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[15]  Kazuyuki Aihara,et al.  Identifying hidden common causes from bivariate time series: a method using recurrence plots. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[17]  George Sugihara,et al.  Predicting climate effects on Pacific sardine , 2013, Proceedings of the National Academy of Sciences.

[18]  Stefan Haufe,et al.  A critical assessment of connectivity measures for EEG data: A simulation study , 2013, NeuroImage.

[19]  Kazuyuki Aihara,et al.  Identifying critical transitions of complex diseases based on a single sample , 2014, Bioinform..

[20]  G. Rangarajan,et al.  Multiple Nonlinear Time Series with Extended Granger Causality , 2004 .

[21]  J. Martinerie,et al.  Nonlinear analyses of interictal EEG map the brain interdependences in human focal epilepsy , 1999 .

[22]  Zheng Li,et al.  Short time-series microarray analysis: Methods and challenges , 2008, BMC Systems Biology.

[23]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[24]  Kazuyuki Aihara,et al.  Predicting Time Series from Short-Term High-Dimensional Data , 2014, Int. J. Bifurc. Chaos.

[25]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[26]  J. H. Hofmeyr,et al.  The reversible Hill equation: how to incorporate cooperative enzymes into metabolic models , 1997, Comput. Appl. Biosci..

[27]  C. Granger.  Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[28]  S. Shen-Orr,et al.  Network motifs in the transcriptional regulation network of Escherichia coli , 2002, Nature Genetics.

[29]  D. Floreano,et al.  Revealing strengths and weaknesses of methods for gene network inference , 2010, Proceedings of the National Academy of Sciences.

[30]  Jürgen Kurths,et al.  Unraveling gene regulatory networks from time-resolved gene expression data -- a measures comparison study , 2011, BMC Bioinformatics.

[31]  Kazuyuki Aihara,et al.  Detecting early-warning signals for sudden deterioration of complex diseases by dynamical network biomarkers , 2012, Scientific Reports.

[32]  Trupti Joshi,et al.  Inferring gene regulatory networks from multiple microarray datasets , 2006, Bioinform..

[33]  Daniele Marinazzo,et al.  Radial basis function approach to nonlinear Granger causality of time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Masamitsu Iino,et al.  System-level identification of transcriptional circuits underlying mammalian circadian clocks , 2005, Nature Genetics.

[35]  M Palus,et al.  Synchronization as adjustment of information rates: detection from bivariate time series. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[37]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[38]  J Kurths,et al.  Inner composition alignment for inferring directed networks from short time series. , 2011, Physical review letters.

[39]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[40]  Ethan D Buhr,et al.  Molecular components of the Mammalian circadian clock. , 2013, Handbook of experimental pharmacology.

[41]  P. Grassberger,et al.  A robust method for detecting interdependences: application to intracranially recorded EEG , 1999, chao-dyn/9907013.

[42]  Jonathan F. Donges,et al.  Geometric detection of coupling directions by means of inter-system recurrence networks , 2012, 1301.0934.

[43]  Kathleen Marchal,et al.  SynTReN: a generator of synthetic gene expression data for design and analysis of structure learning algorithms , 2006, BMC Bioinformatics.

[44]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.