Covariance matrix estimation and linear process bootstrap for multivariate time series of possibly increasing dimension

Multivariate time series present many challenges, especially when they are high dimensional. The paper’s focus is twofold. First, we address the subject of consistently estimating the autocovariance sequence; this is a sequence of matrices that we conveniently stack into one huge matrix. We are then able to show consistency of an estimator based on the so-called flat-top tapers; most importantly, the consistency holds true even when the time series dimension is allowed to increase with the sample size. Secondly, we revisit the linear process bootstrap (LPB) procedure proposed by McMurry and Politis (Journal of Time Series Analysis, 2010) for univariate time series. Based on the aforementioned stacked autocovariance matrix estimator, we are able to define a version of the LPB valid for multivariate time series. Under rather general assumptions, we show that our multivariate linear process bootstrap (MLPB) has asymptotic validity for the sample mean in two important cases: (a) when the time series dimension is fixed, and (b) when it is allowed to increase with sample size. As an aside, in case (a) we show that the MLPB works also for spectral density estimators which is a novel result even in the univariate case. We conclude with a simulation study that demonstrates the superiority of the MLPB in some important cases.

[1]  Richard A. Davis,et al.  Time Series: Theory and Methods (2Nd Edn) , 1993 .

[2]  Joseph P. Romano,et al.  BIAS‐CORRECTED NONPARAMETRIC SPECTRAL ESTIMATION , 1995 .

[3]  P. Doukhan.  Mixing: Properties and Examples , 1994 .

[4]  D. Politis.  The Impact of Bootstrap Methods on Time Series Analysis , 2003 .

[5]  Jérôme Dedecker,et al.  A new covariance inequality and applications , 2003 .

[6]  Jens-Peter Kreiss,et al.  The multiple hybrid bootstrap - Resampling multivariate linear processes , 2010, J. Multivar. Anal..

[7]  Lutz Kilian,et al.  Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity , 2007 .

[8]  D. Politis.  Adaptive bandwidth choice , 2003 .

[9]  D. Politis.  On Nonparametric Function Estimation with Infinite-Order Flat-Top Kernels , 2000 .

[10]  Eric R. Ziegel,et al.  Time Series: Theory and Methods (2nd ed,) , 2012 .

[11]  D. Politis,et al.  Banded and tapered estimates for autocovariance matrices and the linear process bootstrap , 2010 .

[12]  D. Brillinger.  Time series - data analysis and theory , 1981, Classics in applied mathematics.

[13]  Z. Drmač,et al.  On the Perturbation of the Cholesky Factorization , 1994 .

[14]  D. Politis,et al.  On the range of validity of the autoregressive sieve bootstrap , 2012, 1201.6211.

[15]  Jorma Rissanen,et al.  Properties of infinite covariance matrices and stability of optimum predictors , 1969, Inf. Sci..

[16]  C. Jentsch.  A new frequency domain approach of testing for covariance stationarity and for periodic stationarity in multivariate linear processes , 2012 .

[17]  Richard A. Davis,et al.  Time Series: Theory and Methods (2nd ed.). , 1992 .

[18]  Alan David Hutson,et al.  Resampling Methods for Dependent Data , 2004, Technometrics.

[19]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[20]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[21]  Harrison H. Zhou,et al.  Optimal rates of convergence for estimating Toeplitz covariance matrices , 2013 .

[22]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[23]  Regina Y. Liu.  Moving blocks jackknife and bootstrap capture weak dependence , 1992 .

[24]  D. Politis.  HIGHER-ORDER ACCURATE, POSITIVE SEMIDEFINITE ESTIMATION OF LARGE-SAMPLE COVARIANCE AND SPECTRAL DENSITY MATRICES , 2005, Econometric Theory.

[25]  Efstathios Paparoditis,et al.  Bootstrap methods for dependent data: A review , 2011 .

[26]  X. Shao,et al.  The Dependent Wild Bootstrap , 2010 .

[27]  Efstathios Paparoditis,et al.  Frequency Domain Bootstrap for Time Series , 2002 .

[28]  ESTIMATION OF THE COEFFICIENTS OF A MULTIVARIATE LINEAR FILTER USING THE INNOVATIONS ALGORITHM , 1997 .

[29]  Peter F. de Jong,et al.  A central limit theorem for generalized quadratic forms , 1987 .

[30]  J. Davidson.  Stochastic Limit Theory , 1994 .

[31]  W. Wu,et al.  Nonlinear system theory: another look at dependence. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  W. Härdle,et al.  Bootstrap Methods for Time Series , 2003 .

[33]  P. Bühlmann.  Sieve bootstrap for time series , 1997 .

[34]  G. Reinsel,et al.  Prediction of multivariate time series by autoregressive model fitting , 1985 .

[35]  P. Doukhan,et al.  Weak Dependence: With Examples and Applications , 2007 .

[36]  M. Pourahmadi,et al.  BANDING SAMPLE AUTOCOVARIANCE MATRICES OF STATIONARY PROCESSES , 2009 .

[37]  D. Politis,et al.  Valid Resampling of Higher-Order Statistics Using the Linear Process Bootstrap and Autoregressive Sieve Bootstrap , 2013 .

[38]  E. J. Hannan,et al.  Multiple time series , 1970 .

[39]  P. Bühlmann.  Bootstraps for Time Series , 2002 .

[40]  Jens-Peter Kreiss.  Bootstrap procedures for AR (∞) — processes , 1992 .

[41]  J. Davidson.  Stochastic Limit Theory: An Introduction for Econometricians , 1994 .

[42]  Richard A. Davis,et al.  Simple consistent estimation of the coefficients of a linear filter , 1988 .

[43]  Joseph P. Romano,et al.  A General Resampling Scheme for Triangular Arrays of $\alpha$-Mixing Random Variables with Application to the Problem of Spectral Density Estimation , 1992 .

[44]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[45]  H. Künsch.  The Jackknife and the Bootstrap for General Stationary Observations , 1989 .