Applying the Method of Small-shuffle Surrogate Data: Testing for Dynamics in fluctuating Data with Trends

We describe a method for identifying dynamics in irregular time series (short term variability). The method we propose focuses attention on the flow of information in the data. We can apply the method even for irregular fluctuations which exhibit long term trends (periodicities): situations in which previously proposed surrogate methods would give erroneous results. The null hypothesis addressed by our algorithm is that irregular fluctuations are independently distributed random variables (in other words, there is no short term dynamics). The method is demonstrated for numerical data generated by known systems, and applied to several actual time series.

[1]  T. Schreiber,et al.  Discrimination power of measures for nonlinearity in a time series , 1997, chao-dyn/9909043.

[2]  Jeffrey M. Hausdorff,et al.  Multiscaled randomness: A possible source of 1/f noise in biology. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[3]  Tang,et al.  Self-Organized Criticality: An Explanation of 1/f Noise , 2011 .

[4]  Dimitris Kugiumtzis,et al.  On the Reliability of the surrogate Data Test for nonlinearity in the Analysis of noisy Time Series , 2001, Int. J. Bifurc. Chaos.

[5]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[6]  M. Small,et al.  Detecting periodicity in experimental data using linear modeling techniques , 1998, physics/9810021.

[7]  Schreiber,et al.  Improved Surrogate Data for Nonlinearity Tests. , 1996, Physical review letters.

[8]  Paul Manneville.  Intermittency in dissipative dynamical systems , 1980 .

[9]  D. T. Kaplan,et al.  Nonlinear dynamics and time series : building a bridge between the natural and statistical sciences , 2006 .

[10]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[11]  M. Small.  Applied Nonlinear Time Series Analysis: Applications in Physics, Physiology and Finance , 2005 .

[12]  K. Dolan,et al.  Surrogate for nonlinear time series analysis. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Kazuyuki Aihara,et al.  Lyapunov Spectral Analysis on Random Data , 1997 .

[14]  P. Rapp,et al.  Re-examination of the evidence for low-dimensional, nonlinear structure in the human electroencephalogram. , 1996, Electroencephalography and clinical neurophysiology.

[15]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[16]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[17]  Andreas Galka,et al.  Topics in Nonlinear Time Series Analysis, with Implications for Eeg Analysis , 2000 .

[18]  Paul Manneville,et al.  Intermittency, self-similarity and 1/f spectrum in dissipative dynamical systems , 1980 .

[19]  James Theiler,et al.  Using \surrogate Surrogate Data" to Calibrate the Actual Rate of False Positives in Tests for Nonlinearity in Time Series , 2007 .

[20]  K. Ikeda.  Multiple-valued stationary state and its instability of the transmitted light by a ring cavity system , 1979 .

[21]  Tanya Schmah,et al.  Surrogate Data Pathologies and the False-positive rejection of the Null Hypothesis , 2001, Int. J. Bifurc. Chaos.

[22]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[23]  P. Rapp,et al.  Comparative study of embedding methods. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  A. Mees,et al.  On selecting models for nonlinear time series , 1995 .

[25]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[26]  Michael Small,et al.  Small-shuffle surrogate data: testing for dynamics in fluctuating data with trends. , 2005 .

[27]  Michael Small,et al.  Surrogate Test for Pseudoperiodic Time Series Data , 2001 .

[28]  James Theiler,et al.  On the evidence for how-dimensional chaos in an epileptic electroencephalogram , 1995 .

[29]  Joydeep Bhattacharya,et al.  Detection of weak chaos in infant respiration , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[30]  James Theiler,et al.  Constrained-realization Monte-carlo Method for Hypothesis Testing , 1996 .

[31]  Kevin Judd,et al.  Embedding as a modeling problem , 1998 .

[32]  Michael Small,et al.  Surrogate test to distinguish between chaotic and pseudoperiodic time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Kevin Judd,et al.  Refinements to Model Selection for Nonlinear Time Series , 2003, Int. J. Bifurc. Chaos.