Parametric Construction of Episode Networks from Pseudoperiodic Time Series Based on Mutual Information

Recently, the construction of networks from time series data has gained widespread interest. In this paper, we develop this area further by introducing a network construction procedure for pseudoperiodic time series. We call such networks episode networks, in which an episode corresponds to a temporal interval of a time series, and which defines a node in the network. Our model includes a number of features which distinguish it from current methods. First, the proposed construction procedure is a parametric model which allows it to adapt to the characteristics of the data; the length of an episode being the parameter. As a direct consequence, networks of minimal size containing the maximal information about the time series can be obtained. In this paper, we provide an algorithm to determine the optimal value of this parameter. Second, we employ estimates of mutual information values to define the connectivity structure among the nodes in the network to exploit efficiently the nonlinearities in the time series. Finally, we apply our method to data from electroencephalogram (EEG) experiments and demonstrate that the constructed episode networks capture discriminative information from the underlying time series that may be useful for diagnostic purposes.

[1]  Structure of strange attractor and homoclinic bifurcation of two-dimensional cubic map , 1984 .

[2]  竹安 数博,et al.  Time series analysis and its applications , 2007 .

[3]  M. Dehmer,et al.  Influence of the Time Scale on the Construction of Financial Networks , 2010, PloS one.

[4]  D. Long Networks of the Brain , 2011 .

[5]  Michael C. Mackey,et al.  From Clocks to Chaos , 1988 .

[6]  Michael Ruogu Zhang,et al.  Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. , 1998, Molecular biology of the cell.

[7]  K Lehnertz,et al.  Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Matthias Dehmer,et al.  Identifying critical financial networks of the DJIA: Toward a network-based index , 2010, Complex..

[9]  B. Luque,et al.  Horizontal visibility graphs: exact results for random time series. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  C. Stam,et al.  Nonlinear dynamical analysis of EEG and MEG: Review of an emerging field , 2005, Clinical Neurophysiology.

[12]  John Scott What is social network analysis , 2010 .

[13]  A. Butte,et al.  Discovering functional relationships between RNA expression and chemotherapeutic susceptibility using relevance networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Karl J. Friston Causal Modelling and Brain Connectivity in Functional Magnetic Resonance Imaging , 2009, PLoS biology.

[15]  R. Mantegna Hierarchical structure in financial markets , 1998, cond-mat/9802256.

[16]  Lucas Lacasa,et al.  From time series to complex networks: The visibility graph , 2008, Proceedings of the National Academy of Sciences.

[17]  Chris Wiggins,et al.  ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context , 2004, BMC Bioinformatics.

[18]  L. Goddard Information Theory , 1962, Nature.

[19]  Gábor Csárdi,et al.  The igraph software package for complex network research , 2006 .

[20]  Peter Langfelder,et al.  Eigengene networks for studying the relationships between co-expression modules , 2007, BMC Systems Biology.

[21]  G. Altay,et al.  Structural influence of gene networks on their inference: analysis of C3NET. , 2011 .

[22]  G. Sposito,et al.  Graph theory and theoretical physics , 1969 .

[23]  Andrea Califano,et al.  Reverse engineering biological networks. Opportunities and challenges in computational methods for pathway inference. Proceedings of the workshop entitled Dialogue on Reverse Engineering Assessment and Methods (DREAM). September 7-8, 2006. Bronx, New York, USA. , 2007, Annals of the New York Academy of Sciences.

[24]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[25]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[26]  Frank Harary,et al.  Graph Theory , 2016 .

[27]  Matthias Dehmer Structural Analysis of Complex Networks , 2010 .

[28]  BontempiGianluca,et al.  Information-theoretic inference of large transcriptional regulatory networks , 2007 .

[29]  Tom A. B. Snijders,et al.  Social Network Analysis , 2011, International Encyclopedia of Statistical Science.

[30]  Tian Zheng,et al.  Inference of Regulatory Gene Interactions from Expression Data Using Three‐Way Mutual Information , 2009, Annals of the New York Academy of Sciences.

[31]  M Small,et al.  Complex network from pseudoperiodic time series: topology versus dynamics. , 2006, Physical review letters.

[32]  Matthias Dehmer,et al.  Identifying critical financial networks of the DJIA: Toward a network-based index , 2010 .

[33]  Muhammad Sahimi,et al.  Mapping stochastic processes onto complex networks , 2009 .

[34]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[35]  Jürgen Kurths,et al.  Recurrence networks—a novel paradigm for nonlinear time series analysis , 2009, 0908.3447.

[36]  B. Shipley Cause and correlation in biology , 2000 .

[37]  A. Dasgupta Asymptotic Theory of Statistics and Probability , 2008 .

[38]  Hongzhe Li,et al.  Gradient directed regularization for sparse Gaussian concentration graphs, with applications to inference of genetic networks. , 2006, Biostatistics.

[39]  Rainer Breitling,et al.  What is Systems Biology? , 2010, Front. Physiology.

[40]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[41]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[42]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .

[43]  Reinhard Diestel,et al.  Graph Theory , 1997 .

[44]  Frank Emmert-Streib,et al.  Inferring the conservative causal core of gene regulatory networks , 2010, BMC Systems Biology.

[45]  Wentian Li Mutual information functions versus correlation functions , 1990 .

[46]  Marco Grzegorczyk,et al.  Comparative evaluation of reverse engineering gene regulatory networks with relevance networks, graphical gaussian models and bayesian networks , 2006, Bioinform..

[47]  Edda Klipp,et al.  Systems Biology , 1994 .

[48]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[49]  Mark J. van der Laan,et al.  A causal inference approach for constructing transcriptional regulatory networks , 2005, Bioinform..

[50]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[51]  Zhen Su,et al.  Analyzing circadian expression data by harmonic regression based on autoregressive spectral estimation , 2010, Bioinform..

[52]  F Emmert-Streib,et al.  Networks for systems biology: conceptual connection of data and function. , 2011, IET systems biology.

[53]  J. Collins,et al.  Large-Scale Mapping and Validation of Escherichia coli Transcriptional Regulation from a Compendium of Expression Profiles , 2007, PLoS biology.

[54]  Andy M. Yip,et al.  Gene network interconnectedness and the generalized topological overlap measure , 2007, BMC Bioinformatics.

[55]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[56]  M. Dehmer,et al.  Analysis of Complex Networks: From Biology to Linguistics , 2009 .

[57]  Stefan Bornholdt,et al.  Handbook of Graphs and Networks: From the Genome to the Internet , 2003 .

[58]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering , 1994 .

[59]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[60]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[61]  Kevin P. Keegan,et al.  Meta-Analysis of Drosophila Circadian Microarray Studies Identifies a Novel Set of Rhythmically Expressed Genes , 2007, PLoS Comput. Biol..

[62]  Kevin Kontos,et al.  Information-Theoretic Inference of Large Transcriptional Regulatory Networks , 2007, EURASIP J. Bioinform. Syst. Biol..

[63]  Marcus Kaiser,et al.  Hierarchy and Dynamics of Neural Networks , 2010, Front. Neuroinform..

[64]  M Small,et al.  Detecting chaos in pseudoperiodic time series without embedding. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  J. Röschke,et al.  Discrimination of sleep stages: a comparison between spectral and nonlinear EEG measures. , 1996, Electroencephalography and clinical neurophysiology.

[66]  Robin Wilson,et al.  Modern Graph Theory , 2013 .

[67]  G. Glazko,et al.  Network biology: a direct approach to study biological function , 2011, Wiley interdisciplinary reviews. Systems biology and medicine.