Time series analysis via network science: Concepts and algorithms

There is nowadays a constant flux of data being generated and collected in all types of real world systems. These data sets are often indexed by time, space, or both requiring appropriate approaches to analyze the data. In univariate settings, time series analysis is a mature field. However, in multivariate contexts, time series analysis still presents many limitations. In order to address these issues, the last decade has brought approaches based on network science. These methods involve transforming an initial time series data set into one or more networks, which can be analyzed in depth to provide insight into the original time series. This review provides a comprehensive overview of existing mapping methods for transforming time series into networks for a wide audience of researchers and practitioners in machine learning, data mining, and time series. Our main contribution is a structured review of existing methodologies, identifying their main characteristics, and their differences. We describe the main conceptual approaches, provide authoritative references and give insight into their advantages and limitations in a unified way and language. We first describe the case of univariate time series, which can be mapped to single layer networks, and we divide the current mappings based on the underlying concept: visibility, transition, and proximity. We then proceed with multivariate time series discussing both single layer and multiple layer approaches. Although still very recent, this research area has much potential and with this survey we intend to pave the way for future research on the topic.

[1]  Y. Shin,et al.  Generalized Impulse Response Analysis in Linear Multivariate Models , 1998 .

[2]  L. Amaral,et al.  Duality between Time Series and Networks , 2011, PloS one.

[3]  Henri Nyberg,et al.  Generalized Forecast Error Variance Decomposition for Linear and Nonlinear Multivariate Models , 2014 .

[4]  G. Caldarelli,et al.  Networks of equities in financial markets , 2004 .

[5]  L. da F. Costa,et al.  Characterization of complex networks: A survey of measurements , 2005, cond-mat/0505185.

[6]  Jurgen Kurths,et al.  Testing time series irreversibility using complex network methods , 2012, 1211.1162.

[7]  M. Small,et al.  Multiscale ordinal network analysis of human cardiac dynamics , 2017, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[8]  S. Shen-Orr,et al.  Superfamilies of Evolved and Designed Networks , 2004, Science.

[9]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[10]  Bo Zhang,et al.  Volatility behavior of visibility graph EMD financial time series from Ising interacting system , 2015 .

[11]  竹安 数博,et al.  Time series analysis and its applications , 2007 .

[12]  Lu Liu,et al.  Encoding Temporal Markov Dynamics in Graph for Visualizing and Mining Time Series , 2016, AAAI Workshops.

[13]  L M Hively,et al.  Detecting dynamical changes in time series using the permutation entropy. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Lucas Lacasa,et al.  Description of stochastic and chaotic series using visibility graphs. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Ningde Jin,et al.  Sequential limited penetrable visibility-graph motifs , 2020 .

[16]  Zhi-Qiang Jiang,et al.  Universal and nonuniversal allometric scaling behaviors in the visibility graphs of world stock market indices , 2009, 0910.2524.

[17]  F. Ramos,et al.  Quantile graphs for the characterization of chaotic dynamics in time series , 2015, 2015 Third World Conference on Complex Systems (WCCS).

[18]  A. M. Lyapunov The general problem of the stability of motion , 1992 .

[19]  J. Kurths,et al.  Analytical framework for recurrence network analysis of time series. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Luciano Telesca,et al.  Analysis of seismic sequences by using the method of visibility graph , 2012 .

[21]  Randal Douc,et al.  Nonlinear Time Series: Theory, Methods and Applications with R Examples , 2014 .

[22]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[23]  Zhongke Gao,et al.  Complex network from time series based on phase space reconstruction. , 2009, Chaos.

[24]  Dino Sejdinovic,et al.  Detecting and quantifying causal associations in large nonlinear time series datasets , 2017, Science Advances.

[25]  Lucas Lacasa,et al.  On the spectral properties of Feigenbaum graphs , 2019, Journal of Physics A: Mathematical and Theoretical.

[26]  Yue Yang,et al.  Complex network-based time series analysis , 2008 .

[27]  Yong Deng,et al.  A novel visibility graph transformation of time series into weighted networks , 2018, Chaos, Solitons & Fractals.

[28]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[29]  A. Snarskii,et al.  From the time series to the complex networks: The parametric natural visibility graph , 2012, 1208.6365.

[30]  B. Luque,et al.  Horizontal visibility graphs: exact results for random time series. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Wei-Xing Zhou,et al.  Superfamily classification of nonstationary time series based on DFA scaling exponents , 2009, 0912.2016.

[32]  Yun Long Visibility graph network analysis of gold price time series , 2013 .

[33]  Jonathan F. Donges,et al.  Complex Network Analysis of Recurrences , 2015 .

[34]  J. M. R. Parrondo,et al.  Time series irreversibility: a visibility graph approach , 2012 .

[35]  Hojjat Adeli,et al.  New diagnostic EEG markers of the Alzheimer’s disease using visibility graph , 2010, Journal of Neural Transmission.

[36]  Bernhard Schölkopf,et al.  Inferring causation from time series in Earth system sciences , 2019, Nature Communications.

[37]  Fengzhen Hou,et al.  Visibility graph analysis of very short-term heart rate variability during sleep , 2016 .

[38]  Zhou Ting-Ting,et al.  Limited penetrable visibility graph for establishing complex network from time series , 2012 .

[39]  Lucas Antiqueira,et al.  Analyzing and modeling real-world phenomena with complex networks: a survey of applications , 2007, 0711.3199.

[40]  Rong Zhang,et al.  Forecasting Construction Cost Index based on visibility graph: A network approach , 2018 .

[41]  Yong Deng,et al.  A novel method for forecasting time series based on fuzzy logic and visibility graph , 2017, Advances in Data Analysis and Classification.

[42]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[43]  M. Hallin,et al.  Generalized Dynamic Factor Models and Volatilities: Recovering the Market Volatility Shocks , 2016 .

[44]  Norbert Marwan,et al.  Identification of dynamical transitions in marine palaeoclimate records by recurrence network analysis , 2011 .

[45]  G. Ambika,et al.  Can recurrence networks show small-world property? , 2015, 1509.04528.

[46]  Thomas H. Parker,et al.  What is π , 1991 .

[47]  G. Ambika,et al.  Weighted recurrence networks for the analysis of time-series data , 2017, Proceedings of the Royal Society A.

[48]  Jiang Wang,et al.  WLPVG approach to the analysis of EEG-based functional brain network under manual acupuncture , 2014, Cognitive Neurodynamics.

[49]  Alexander Mendiburu,et al.  Distance Measures for Time Series in R: The TSdist Package , 2016, R J..

[50]  Shi-Min Cai,et al.  Influence network in the Chinese stock market , 2015 .

[51]  Simone Severini,et al.  A characterization of horizontal visibility graphs and combinatorics on words , 2010, 1010.1850.

[52]  Jiang Wang,et al.  Functional brain networks in Alzheimer’s disease: EEG analysis based on limited penetrable visibility graph and phase space method , 2016 .

[53]  Wei-Xing Zhou,et al.  Statistical properties of visibility graph of energy dissipation rates in three-dimensional fully developed turbulence , 2009, 0905.1831.

[54]  Eiko I. Fried,et al.  A Tutorial on Regularized Partial Correlation Networks , 2016, Psychological methods.

[55]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[56]  Tao Zhou,et al.  HIERARCHICAL ORGANIZATION AND DISASSORTATIVE MIXING OF CORRELATION-BASED WEIGHTED FINANCIAL NETWORKS , 2010 .

[57]  Michael Small,et al.  Time lagged ordinal partition networks for capturing dynamics of continuous dynamical systems. , 2015, Chaos.

[58]  Arthur A. B. Pessa,et al.  Characterizing stochastic time series with ordinal networks. , 2019, Physical review. E.

[59]  Lucas Lacasa,et al.  Sequential visibility-graph motifs. , 2015, Physical review. E.

[60]  Vanessa Alexandra Freitas da Silva,et al.  Time Series Analysis based on Complex Networks , 2018 .

[61]  Bo He,et al.  Construction of complex networks from time series based on the cross correlation interval , 2017 .

[62]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[63]  Yi Zhao,et al.  Reciprocal characterization from multivariate time series to multilayer complex networks. , 2020, Chaos.

[64]  Emily A. Fogarty,et al.  Visibility network of United States hurricanes , 2009 .

[65]  Yong Deng,et al.  Fast transformation from time series to visibility graphs. , 2015, Chaos.

[66]  Michael Small,et al.  Transforming Time Series into Complex Networks , 2009, Complex.

[67]  Hideyuki Suzuki,et al.  Change-point detection with recurrence networks , 2013 .

[68]  Michael Small,et al.  Counting forbidden patterns in irregularly sampled time series. II. Reliability in the presence of highly irregular sampling. , 2016, Chaos.

[69]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[70]  Huijie Yang,et al.  Pattern interdependent network of cross-correlation in multivariate time series , 2020 .

[71]  G. Cecchi,et al.  Scale-free brain functional networks. , 2003, Physical review letters.

[72]  F. Takens Detecting strange attractors in turbulence , 1981 .

[73]  Lucas Lacasa,et al.  Visibility graphs for fMRI data: Multiplex temporal graphs and their modulations across resting-state networks , 2017, bioRxiv.

[74]  Michael Small,et al.  Superfamily phenomena and motifs of networks induced from time series , 2008, Proceedings of the National Academy of Sciences.

[75]  Shuguang Guan,et al.  Ordinal partition transition network based complexity measures for inferring coupling direction and delay from time series. , 2019, Chaos.

[76]  Gang Feng,et al.  Time series analysis of the developed financial markets' integration using visibility graphs , 2014 .

[77]  A. Rbnyi ON THE EVOLUTION OF RANDOM GRAPHS , 2001 .

[78]  Daolin Xu,et al.  Predicting catastrophes of non-autonomous networks with visibility graphs and horizontal visibility , 2018 .

[79]  Z. Shao Network analysis of human heartbeat dynamics , 2010 .

[80]  D. Sornette,et al.  Comparing the performance of FA, DFA and DMA using different synthetic long-range correlated time series , 2012, Scientific Reports.

[81]  Changgui Gu,et al.  Visibility graphlet approach to chaotic time series. , 2016, Chaos.

[82]  Lucas Lacasa,et al.  Sequential motif profile of natural visibility graphs. , 2016, Physical review. E.

[83]  Matteo Barigozzi,et al.  A network analysis of the volatility of high dimensional financial series , 2017 .

[84]  Lixin Tian,et al.  Exact results of the limited penetrable horizontal visibility graph associated to random time series and its application , 2017, Scientific Reports.

[85]  Erwin Doescher,et al.  Application of Quantile Graphs to the Automated Analysis of EEG Signals , 2018, Neural Processing Letters.

[86]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[87]  F. Diebold,et al.  UNIVERSITY OF SOUTHERN CALIFORNIA Center for Applied Financial Economics (CAFE) On the Network Topology of Variance Decompositions: Measuring the Connectedness of Financial Firms , 2011 .

[88]  O. Rössler An equation for continuous chaos , 1976 .

[89]  Robert Jenssen,et al.  Multiplex visibility graphs to investigate recurrent neural network dynamics , 2016, Scientific Reports.

[90]  J. Kurths,et al.  Complex network approach for recurrence analysis of time series , 2009, 0907.3368.

[91]  Lucas Lacasa,et al.  From time series to complex networks: The visibility graph , 2008, Proceedings of the National Academy of Sciences.

[92]  Michael Small,et al.  Recurrence-based time series analysis by means of complex network methods , 2010, Int. J. Bifurc. Chaos.

[93]  Jürgen Kurths,et al.  Recurrence networks—a novel paradigm for nonlinear time series analysis , 2009, 0908.3447.

[94]  Jakob Runge,et al.  Quantifying the Strength and Delay of Climatic Interactions: The Ambiguities of Cross Correlation and a Novel Measure Based on Graphical Models , 2014 .

[95]  M. Porter What Is... a Multilayer Network? , 2018, Notices of the American Mathematical Society.

[96]  Rong Zhang,et al.  Visibility graph analysis for re-sampled time series from auto-regressive stochastic processes , 2017, Commun. Nonlinear Sci. Numer. Simul..

[97]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[98]  Michael Small,et al.  Multiscale characterization of recurrence-based phase space networks constructed from time series. , 2012, Chaos.

[99]  Sarbjeet Singh,et al.  Analyzing negative ties in social networks: A survey , 2016 .

[100]  Shuguang Guan,et al.  Cross and joint ordinal partition transition networks for multivariate time series analysis , 2018, Frontiers of Physics.

[101]  Zhong-Ke Gao,et al.  Multivariate weighted recurrence network inference for uncovering oil-water transitional flow behavior in a vertical pipe. , 2016, Chaos.

[102]  Alessandro Vespignani,et al.  Twenty years of network science , 2018, Nature.

[103]  Yan Li,et al.  Analysis and Classification of Sleep Stages Based on Difference Visibility Graphs From a Single-Channel EEG Signal , 2014, IEEE Journal of Biomedical and Health Informatics.

[104]  M. Small,et al.  Constructing networks from a dynamical system perspective for multivariate nonlinear time series. , 2016, Physical review. E.

[105]  William W. S. Wei,et al.  Multivariate Time Series Analysis and Applications , 2019, Wiley Series in Probability and Statistics.

[106]  Kazuyuki Aihara,et al.  Coarse-graining time series data: Recurrence plot of recurrence plots and its application for music. , 2016, Chaos.

[107]  Yanchun Zhang,et al.  Weighted Visibility Graph With Complex Network Features in the Detection of Epilepsy , 2016, IEEE Access.

[108]  Jürgen Kurths,et al.  Multivariate recurrence network analysis for characterizing horizontal oil-water two-phase flow. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[109]  Wen-Jie Xie,et al.  Tetradic motif profiles of horizontal visibility graphs , 2018, Commun. Nonlinear Sci. Numer. Simul..

[110]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[111]  Zhiyong Yuan,et al.  A Novel EEG Sleep Staging Method for Wearable Devices Based on Amplitude-time Mapping , 2019, 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM).

[112]  Subir Kumar Ghosh,et al.  Visibility Algorithms in the Plane , 2007 .

[113]  Jürgen Kurths,et al.  Identifying causal gateways and mediators in complex spatio-temporal systems , 2015, Nature Communications.

[114]  J. C. Nuño,et al.  The visibility graph: A new method for estimating the Hurst exponent of fractional Brownian motion , 2009, 0901.0888.

[115]  S. Shen-Orr,et al.  Networks Network Motifs : Simple Building Blocks of Complex , 2002 .

[116]  Lucas Lacasa,et al.  Visibility Algorithms: A Short Review , 2012 .

[117]  Yue Yang,et al.  Visibility graph approach to exchange rate series , 2009 .

[118]  Lucas Lacasa,et al.  Detecting Series Periodicity with Horizontal Visibility Graphs , 2012, Int. J. Bifurc. Chaos.

[119]  Fabrizio Lillo,et al.  Correlation, Hierarchies, and Networks in Financial Markets , 2008, 0809.4615.

[120]  Martín Gómez Ravetti,et al.  Distinguishing Noise from Chaos: Objective versus Subjective Criteria Using Horizontal Visibility Graph , 2014, PloS one.

[121]  J. Kurths,et al.  Complex network approaches to nonlinear time series analysis , 2019, Physics Reports.

[122]  Jonathan F. Donges,et al.  Using Causal Effect Networks to Analyze Different Arctic Drivers of Midlatitude Winter Circulation , 2016 .

[123]  Lixin Tian,et al.  From time series to complex networks: The phase space coarse graining , 2016 .

[124]  Andriana S. L. O. Campanharo,et al.  Hurst exponent estimation of self-affine time series using quantile graphs , 2016 .

[125]  Anastasios A. Tsonis,et al.  Review article "On the origins of decadal climate variability: a network perspective" , 2012 .

[126]  Wei-Dong Dang,et al.  Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series , 2016, Scientific Reports.

[127]  J. Kurths,et al.  Power-laws in recurrence networks from dynamical systems , 2012, 1203.3345.

[128]  Jacques Klein,et al.  Extracting Statistical Graph Features for Accurate and Efficient Time Series Classification , 2018, EDBT.

[129]  M Small,et al.  Detecting chaos in pseudoperiodic time series without embedding. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[130]  Ruggero Sainaghi,et al.  Mapping time series into networks as a tool to assess the complex dynamics of tourism systems , 2016 .

[131]  Norbert Marwan,et al.  The geometry of chaotic dynamics — a complex network perspective , 2011, 1102.1853.

[132]  Jonathan F. Donges,et al.  Geometric detection of coupling directions by means of inter-system recurrence networks , 2012, 1301.0934.

[133]  Jürgen Kurths,et al.  Multivariate recurrence plots , 2004 .

[134]  N. Marwan,et al.  Nonlinear analysis of bivariate data with cross recurrence plots , 2002, physics/0201061.

[135]  Gene D. Sprechini,et al.  Using ordinal partition transition networks to analyze ECG data. , 2016, Chaos.

[136]  Norbert Marwan,et al.  Geometric signature of complex synchronisation scenarios , 2013, 1301.0806.

[137]  Canzhong Yao,et al.  A Visibility Graph Approach to CNY Exchange Rate Networks and Characteristic Analysis , 2017 .

[138]  Huijie Yang,et al.  Visibility Graph Based Time Series Analysis , 2015, PloS one.

[139]  A. Giuliani,et al.  Detecting deterministic signals in exceptionally noisy environments using cross-recurrence quantification , 1998 .

[140]  Zhong-Ke Gao,et al.  A recurrence network-based convolutional neural network for fatigue driving detection from EEG. , 2019, Chaos.

[141]  Michael Small,et al.  Complex networks from time series: Capturing dynamics , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[142]  N. Meinshausen,et al.  High-dimensional graphs and variable selection with the Lasso , 2006, math/0608017.

[143]  Wei Guo,et al.  Characterization of SSMVEP-based EEG signals using multiplex limited penetrable horizontal visibility graph. , 2019, Chaos.

[144]  Zhiyong Gao,et al.  Complex network theory-based condition recognition of electromechanical system in process industry , 2016 .

[145]  Luiz Eduardo Betting,et al.  Quantile graphs for EEG-based diagnosis of Alzheimer’s disease , 2020, PloS one.

[146]  Michael Small,et al.  Memory and betweenness preference in temporal networks induced from time series , 2017, Scientific Reports.

[147]  Jürgen Kurths,et al.  Investigating the topology of interacting networks , 2011, 1102.3067.

[148]  Muhammad Sahimi,et al.  Mapping stochastic processes onto complex networks , 2009 .

[149]  Ulrik Brandes,et al.  What is network science? , 2013, Network Science.

[150]  Jürgen Kurths,et al.  Multiplex recurrence networks. , 2018, Physical review. E.

[151]  Fernanda Strozzi,et al.  Recurrence Networks: Evolution and Robustness , 2011, Int. J. Bifurc. Chaos.

[152]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[153]  Jari Hyttinen,et al.  Dynamics of intracranial electroencephalographic recordings from epilepsy patients using univariate and bivariate recurrence networks. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[154]  M Garavaglia,et al.  Characterization of Gaussian self-similar stochastic processes using wavelet-based informational tools. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[155]  Jonathan F. Donges,et al.  Visibility graph analysis of geophysical time series: Potentials and possible pitfalls , 2012, Acta Geophysica.

[156]  M Small,et al.  Complex network from pseudoperiodic time series: topology versus dynamics. , 2006, Physical review letters.

[157]  Elizabeth Bradley,et al.  Nonlinear time-series analysis revisited. , 2015, Chaos.

[158]  Norbert Marwan,et al.  A historical review of recurrence plots , 2008, 1709.09971.

[159]  Kate Smith-Miles,et al.  Visualising forecasting algorithm performance using time series instance spaces , 2017 .

[160]  Dan Stowell,et al.  Online visibility graphs: Encoding visibility in a binary search tree , 2019, Physical Review Research.

[161]  Lixin Tian,et al.  Degree distributions and motif profiles of limited penetrable horizontal visibility graphs , 2018, Physica A: Statistical Mechanics and its Applications.

[162]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[163]  Michael Small,et al.  Counting forbidden patterns in irregularly sampled time series. I. The effects of under-sampling, random depletion, and timing jitter. , 2016, Chaos.

[164]  Miguel A. F. Sanjuán,et al.  True and false forbidden patterns in deterministic and random dynamics , 2007 .

[165]  T E Karakasidis,et al.  The application of complex network time series analysis in turbulent heated jets. , 2014, Chaos.

[166]  Jari Saramäki,et al.  Temporal Networks , 2011, Encyclopedia of Social Network Analysis and Mining.

[167]  Matteo Barigozzi,et al.  NETS: Network Estimation for Time Series , 2018 .

[168]  Michael Small,et al.  Constructing ordinal partition transition networks from multivariate time series , 2017, Scientific Reports.

[169]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[170]  Cristina Masoller,et al.  Networks in Climate , 2019 .

[171]  Lucas Lacasa,et al.  Network structure of multivariate time series , 2014, Scientific Reports.

[172]  E. Lorenz Deterministic nonperiodic flow , 1963 .