A topology-based approach for nonlinear time series with applications in computer performance analysis

We present a topology-based methodology for the analysis of experimental data generated by a discrete-time, nonlinear dynamical system. This methodology has significant applications in the field of computer performance analysis. Our approach consists of two parts. In the first part, we propose a novel signal separation algorithm that exploits the continuity of the dynamical system being studied. We use established tools from computational topology to test the connectedness of various regions of state space. In particular, a connected region of space that has a disconnected image under the experimental dynamics suggests the presence of multiple signals in the data. Using this as a guideline, we are able to model experimental data as an Iterated Function System (IFS). We demonstrate the success of our algorithm on several synthetic examples—including a Henon-like IFS. Additionally, we successfully model experimental computer performance data as an IFS. In the second part of the analysis, we represent an experimental dynamical system with an algebraic structure that allows for the computation of algebraic topological invariants. Previous work has shown that a cubical grid and the associated cubical complex are effective tools that can be used to identify isolating neighborhoods and compute the corresponding Conley Index—thereby rigorously verifying the existence of periodic orbits and/or chaotic dynamics. Our contribution is to adapt this technique by altering the underlying data structure--improving flexibility and efficiency. We represent the state space of the dynamical system with a simplicial complex and its induced simplicial multivalued map. This contains information about both geometry and dynamics, whereas the cubical complex is restricted by the geometry of the experimental data. This representation has several advantages; most notably, the complexity of the algorithm that generates the associated simplicial multivalued map is linear in the number of data points—as opposed to exponential in dimension for the cubical multivalued map. The synthesis of the two parts of our methodology results in a nonlinear time-series analysis framework that is particularly well suited for computer performance analysis. Complex computer programs naturally switch between `regimes' and are appropriately modeled as IFSs by part one of our program. Part two of our methodology provides the correct tools for analyzing each regime independently.

[1]  Matthias Hauswirth,et al.  Producing wrong data without doing anything obviously wrong! , 2009, ASPLOS.

[2]  Herbert Edelsbrunner,et al.  An incremental algorithm for Betti numbers of simplicial complexes on the 3-sphere , 1995, Comput. Aided Geom. Des..

[3]  Matthias Hauswirth,et al.  Evaluating the accuracy of Java profilers , 2010, PLDI '10.

[4]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[5]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[6]  M. Mrozek,et al.  Conley index for discrete multi-valued dynamical systems , 1995 .

[7]  坂上 貴之 書評 Computational Homology , 2005 .

[8]  Peter Turchin,et al.  Complex Dynamics in Ecological Time Series , 1992 .

[9]  J. Meiss,et al.  Computing connectedness: disconnectedness and discreteness , 2000 .

[10]  Olivier Temam,et al.  Chaos in computer performance , 2005, Chaos.

[11]  Masashi Sugiyama,et al.  Change-Point Detection in Time-Series Data by Direct Density-Ratio Estimation , 2009, SDM.

[12]  Giorgio Mantica,et al.  Chaotic Optimization and the Construction of Fractals: Solution of an Inverse Problem , 1989, Complex Syst..

[13]  Joshua Garland,et al.  Iterated function system models in data analysis: detection and separation. , 2011, Chaos.

[14]  Konstantin Mischaikow,et al.  An Algorithmic Approach to Chain Recurrence , 2005, Found. Comput. Math..

[15]  L Glass,et al.  Time series analysis of complex dynamics in physiology and medicine. , 1993, Medical progress through technology.

[16]  Y. Wong,et al.  Differentiable Manifolds , 2009 .

[17]  Ping Chen,et al.  Empirical and theoretical evidence of economic chaos , 1988 .

[18]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[19]  James D. Meiss,et al.  Dynamical systems , 2007, Scholarpedia.

[20]  Matthias Hauswirth,et al.  Automating vertical profiling , 2005, OOPSLA '05.

[21]  Loring W. Tu,et al.  Differential forms in algebraic topology , 1982, Graduate texts in mathematics.

[22]  Edward R. Vrscay,et al.  Theory of Generalized Fractal Transforms , 1996 .

[23]  K. Mischaikow,et al.  Chaos in the Lorenz equations: a computer-assisted proof , 1995, math/9501230.

[24]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[25]  E Bradley,et al.  Topology-based signal separation. , 2004, Chaos.

[26]  S. L. Shishkin,et al.  Application of the change-point analysis to the investigation of the brain’s electrical activity , 2000 .

[27]  Dmitry Turaev,et al.  Three-Dimensional HÉnon-like Maps and Wild Lorenz-like attractors , 2005, Int. J. Bifurc. Chaos.

[28]  Giorgio Mantica,et al.  Inverse problems in fractal construction: moment method solution , 1990 .

[29]  E. Kostelich,et al.  Characterization of an experimental strange attractor by periodic orbits. , 1989, Physical review. A, General physics.

[30]  Lieven Eeckhout,et al.  Statistically rigorous java performance evaluation , 2007, OOPSLA.

[31]  F. Takens Detecting strange attractors in turbulence , 1981 .

[32]  Michael F. Barnsley,et al.  Fractals everywhere , 1988 .

[33]  M. Barnsley,et al.  Solution of an inverse problem for fractals and other sets. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[34]  M. Hénon A two-dimensional mapping with a strange attractor , 1976 .

[35]  W Klonowski,et al.  Quantitative measure of complexity of EEG signal dynamics. , 1999, Acta neurobiologiae experimentalis.

[36]  James R. Munkres,et al.  Elements of algebraic topology , 1984 .

[37]  James D. Meiss Differential Dynamical Systems (Monographs on Mathematical Modeling and Computation) , 2007 .

[38]  Marian Mrozek,et al.  An Algorithmic Approach to the Conley Index Theory , 1999 .

[39]  Gunnar E. Carlsson,et al.  Topological estimation using witness complexes , 2004, PBG.

[40]  Lyman P. Hurd,et al.  Fractal image compression , 1993 .

[41]  Mark R. Muldoon,et al.  Iterated function system models of digital channels , 2004, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[42]  C. Conley,et al.  Isolated invariant sets and isolating blocks , 1971 .

[43]  Joshua D. Reiss,et al.  Construction of symbolic dynamics from experimental time series , 1999 .

[44]  Sauer,et al.  Reconstruction of dynamical systems from interspike intervals. , 1994, Physical review letters.

[45]  Holger Kantz,et al.  Practical implementation of nonlinear time series methods: The TISEAN package. , 1998, Chaos.

[46]  Instytut InformatiykiUniwersytet Jagiello From Time Series to Symbolic Dynamics: an Algebraic Topological Approach , 1997 .

[47]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[48]  H. Edelsbrunner,et al.  Persistent Homology — a Survey , 2022 .

[49]  R. Ghrist Barcodes: The persistent topology of data , 2007 .

[50]  Persi Diaconis,et al.  Iterated Random Functions , 1999, SIAM Rev..

[51]  Rafael M. Frongillo,et al.  Algorithms for Rigorous Entropy Bounds and Symbolic Dynamics , 2008, SIAM J. Appl. Dyn. Syst..

[52]  Amer Diwan,et al.  Computer systems are dynamical systems. , 2009, Chaos.

[53]  B. Giraud,et al.  Nonlinear forecasting and iterated function systems. , 1992, Chaos.

[54]  Amer Diwan,et al.  Measurement and Dynamical Analysis of Computer Performance Data , 2010, IDA.

[55]  George Sugihara,et al.  Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series , 1990, Nature.