Local Spectral Analysis via a Bayesian Mixture of Smoothing Splines

In many practical problems, time series are realizations of nonstationary random processes. These processes can often be modeled as processes with slowly changing dynamics or as piecewise stationary processes. In these cases, various approaches to estimating the time-varying spectral density have been proposed. Our approach in this article is to estimate the log of the Dahlhaus local spectrum using a Bayesian mixture of splines. The basic idea of our approach is to first partition the data into small sections. We then assume that the log spectral density of the evolutionary process in any given partition is a mixture of individual log spectra. We use a mixture of smoothing splines model with time varying mixing weights to estimate the evolutionary log spectrum. The mixture model is fit using Markov chain Monte Carlo techniques that yield estimates of the log spectra of the individual subsections. In addition to an estimate of the local log spectral density, the method yields pointwise credible intervals. We use a reversible jump step to automatically determine the number of different spectral components.

[1]  Christophe Andrieu,et al.  Bayesian curve fitting using MCMC with applications to signal segmentation , 2002, IEEE Trans. Signal Process..

[2]  M. Priestley Evolutionary Spectra and Non‐Stationary Processes , 1965 .

[3]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[4]  G. Wahba Spline models for observational data , 1990 .

[5]  P. Green,et al.  Reversible jump MCMC , 2009 .

[6]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[7]  Timothy J. Hoar,et al.  The 1990–1995 El Niño‐Southern Oscillation Event: Longest on Record , 1996 .

[8]  David J. Thomson,et al.  Time series analysis of Holocene climate data , 1990, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[9]  David S. Stoffer,et al.  Time series analysis and its applications , 2000 .

[10]  Robert Kohn,et al.  Semiparametric Bayesian Inference for Time Series with Mixed Spectra , 1996 .

[11]  P. Whittle Curve and Periodogram Smoothing , 1957 .

[12]  H. Ombao,et al.  Smoothing Spline ANOVA for Time-Dependent Spectral Analysis , 2003 .

[13]  Richard A. Davis,et al.  Structural Breaks Estimation for Non-stationary Time Series Models , 2004 .

[14]  Richard A. Davis,et al.  Structural Break Estimation for Nonstationary Time Series Models , 2006 .

[15]  Wilbur Y. Chen,et al.  Assessment of Southern Oscillation Sea-Level Pressure Indices , 1982 .

[16]  A. Timmermann,et al.  Increased El Niño frequency in a climate model forced by future greenhouse warming , 1999, Nature.

[17]  R. Dahlhaus Fitting time series models to nonstationary processes , 1997 .

[18]  G. Kitagawa Smoothness priors analysis of time series , 1996 .

[19]  Sally Wood,et al.  Bayesian mixture of splines for spatially adaptive nonparametric regression , 2002 .

[20]  Genshiro Kitagawa,et al.  A procedure for the modeling of non-stationary time series , 1978 .

[21]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[22]  S. Adak Time dependent spectral analysis of nonstationary time series , 1996 .

[23]  G. Wahba Automatic Smoothing of the Log Periodogram , 1980 .

[24]  Chang Chiann,et al.  Estimation of Time Varying Linear Systems , 1999 .

[25]  J. Raz,et al.  Automatic Statistical Analysis of Bivariate Nonstationary Time Series , 2001 .

[26]  Marc Lavielle,et al.  Optimal segmentation of random processes , 1998, IEEE Trans. Signal Process..