Statistical Significance of Periodicity and Log-Periodicity with Heavy-Tailed Correlated Noise

We estimate the probability that random noise, of several plausible standard distributions, creates a false alarm that a periodicity (or log-periodicity) is found in a time series. The solution of this problem is already known for independent Gaussian distributed noise. We investigate more general situations with non-Gaussian correlated noises and present synthetic tests on the detectability and statistical significance of periodic components. A periodic component of a time series is usually detected by some sort of Fourier analysis. Here, we use the Lomb periodogram analysis, which is suitable and outperforms Fourier transforms for unevenly sampled time series. We examine the false-alarm probability of the largest spectral peak of the Lomb periodogram in the presence of power-law distributed noises, of short-range and of long-range fractional-Gaussian noises. Increasing heavy-tailness (respectively correlations describing persistence) tends to decrease (respectively increase) the false-alarm probability of finding a large spurious Lomb peak. Increasing anti-persistence tends to decrease the false-alarm probability. We also study the interplay between heavy-tailness and long-range correlations. In order to fully determine if a Lomb peak signals a genuine rather than a spurious periodicity, one should in principle characterize the Lomb peak height, its width and its relations to other peaks in the complete spectrum. As a step towards this full characterization, we construct the joint-distribution of the frequency position (relative to other peaks) and of the height of the highest peak of the power spectrum. We also provide the distributions of the ratio of the highest Lomb peak to the second highest one. Using the insight obtained by the present statistical study, we re-examine previously reported claims of "log-periodicity" and find that the credibility for log-periodicity in 2D-freely decaying turbulence is weakened while it is strengthened for fracture, for the ion-signature prior to the Kobe earthquake and for financial markets.

[1]  Olivier Ledoit,et al.  CRASHES AS CRITICAL POINTS , 1998, cond-mat/9810071.

[2]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[3]  D. Sornette,et al.  Significance of log-periodic precursors to financial crashes , 2001, cond-mat/0106520.

[4]  Stanley,et al.  Stochastic process with ultraslow convergence to a Gaussian: The truncated Lévy flight. , 1994, Physical review letters.

[5]  P. Levy.  Théorie de l'addition des variables aléatoires , 1955 .

[6]  D. Applebaum.  Stable non-Gaussian random processes , 1995, The Mathematical Gazette.

[7]  Murad S. Taqqu.  Random processes with long‐range dependence and high variability , 1987 .

[8]  Stephen M. Kogon,et al.  Signal modeling with self-similar α-stable processes: the fractional Levy stable motion model , 1996, IEEE Trans. Signal Process..

[9]  C. Mallows,et al.  A Method for Simulating Stable Random Variables , 1976 .

[10]  D. Sornette,et al.  Reexamination of log periodicity observed in the seismic precursors of the 1989 Loma Prieta earthquake , 2000 .

[11]  T. Huillet.  Fractional Lévy motions and related processes , 1999 .

[12]  J. Scargle.  Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .

[13]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[14]  Rachid Harba,et al.  Quality of synthesis and analysis methods for fractional Brownian motion , 1996, 1996 IEEE Digital Signal Processing Workshop Proceedings.

[15]  Critical Crashes , 1999, cond-mat/9903142.

[16]  D. Sornette,et al.  SPONTANEOUS GENERATION OF DISCRETE SCALE INVARIANCE IN GROWTH MODELS , 1997 .

[17]  Patrick Flandrin,et al.  On the spectrum of fractional Brownian motions , 1989, IEEE Trans. Inf. Theory.

[18]  D. Sornette.  Discrete scale invariance and complex dimensions , 1997, cond-mat/9707012.

[19]  Didier Sornette,et al.  Financial Anti-Bubbles Log-Periodicity in Gold and Nikkei Collapses , 1999, cond-mat/9901268.

[20]  W. Press,et al.  Fast algorithm for spectral analysis of unevenly sampled data , 1989 .

[21]  D. T. Nguyen,et al.  Accurate synthesis of fractional Brownian motion using wavelets , 1994 .

[22]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[23]  D Sornette,et al.  Log-periodic route to fractal functions. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[25]  Didier Sornette,et al.  Predicting Financial Crashes Using Discrete Scale Invariance , 1999 .

[26]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[27]  Conor Heneghan,et al.  Two-dimensional fractional Brownian motion: wavelet analysis and synthesis , 1996, Proceeding of Southwest Symposium on Image Analysis and Interpretation.

[28]  A. Johansen,et al.  Artifactual log‐periodicity in finite size data: Relevance for earthquake aftershocks , 1999, cond-mat/9911421.

[29]  S. Baliunas,et al.  A Prescription for period analysis of unevenly sampled time series , 1986 .

[30]  James B. McDonald,et al.  A Flexible Parametric Garch Model With An Application To Exchange Rates , 2001 .

[31]  Heinz-Otto Peitgen,et al.  The science of fractal images , 2011 .

[32]  J. Huston McCulloch,et al.  ON THE PARAMETRIZATION OF THE AFOCAL STABLE DISTRIBUTIONS , 1996 .

[33]  Modeling the stock market prior to large crashes , 1998, cond-mat/9811066.

[34]  Didier Sornette,et al.  Punctuated vortex coalescence and discrete scale invariance in two-dimensional turbulence , 1999, cond-mat/9902247.

[35]  J. Muzy,et al.  Complex fractal dimensions describe the hierarchical structure of diffusion-limited-aggregate clusters. , 1996, Physical review letters.

[36]  Ilkka Norros,et al.  Simulation of fractional Brownian motion with conditionalized random midpoint displacement , 1999 .

[37]  S. Kay,et al.  Fractional Brownian Motion: A Maximum Likelihood Estimator and Its Application to Image Texture , 1986, IEEE Transactions on Medical Imaging.

[38]  Wavelet synthesis of fractional Brownian motion , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[39]  B. Mandelbrot,et al.  Fractional Brownian Motions, Fractional Noises and Applications , 1968 .

[40]  New evidence of earthquake precursory phenomena in the 17 January 1995 Kobe earthquake, Japan , 1999, cond-mat/9911444.

[41]  Piotr Kokoszka,et al.  Can One Use the Durbin–Levinson Algorithm to Generate Infinite Variance Fractional ARIMA Time Series? , 2001 .

[42]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[43]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[44]  Scott L. Painter,et al.  On the distribution of seismic reflection coefficients and seismic amplitudes , 1995 .

[45]  D. Sornette,et al.  Numerical investigations of discrete scale invariance in fractals and multifractal measures , 2004 .

[46]  Patrick Flandrin,et al.  Wavelet analysis and synthesis of fractional Brownian motion , 1992, IEEE Trans. Inf. Theory.

[47]  C. R. Dietrich,et al.  Fast and Exact Simulation of Stationary Gaussian Processes through Circulant Embedding of the Covariance Matrix , 1997, SIAM J. Sci. Comput..

[48]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[49]  Ayşe Erzan,et al.  Finite q-differences and the discrete renormalization group , 1997 .

[50]  T. Bollerslev,et al.  A CONDITIONALLY HETEROSKEDASTIC TIME SERIES MODEL FOR SPECULATIVE PRICES AND RATES OF RETURN , 1987 .