Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity

The main contribution of this paper is a proof of the asymptotic validity of the application of the bootstrap to AR(∞) processes with unmodelled conditional heteroskedasticity. We first derive the asymptotic properties of the least-squares estimator of the autoregressive sieve parameters when the data are generated by a stationary linear process with martingale difference errors that are possibly subject to conditional heteroskedasticity of unknown form. These results are then used in establishing that a suitably constructed bootstrap estimator will have the same limit distribution as the least-squares estimator. Our results provide theoretical justification for the use of either the conventional asymptotic approximation based on robust standard errors or the bootstrap approximation of the distribution of autoregressive parameters. A simulation study suggests that the bootstrap approach tends to be more accurate in small samples.

[1]  Arnold J Stromberg,et al.  Subsampling , 2001, Technometrics.

[2]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[3]  Stefan Mittnik,et al.  Misspecifications in vector autoregressions and their effects on impulse responses and variance decompositions , 1993 .

[4]  R. Durrett.  Probability: Theory and Examples , 1993 .

[5]  H. Künsch.  The Jackknife and the Bootstrap for General Stationary Observations , 1989 .

[6]  Jens-Peter Kreiss.  Asymptotical Properties of Residual Bootstrap for Autoregressions , 1997 .

[7]  Bruce E. Hansen,et al.  Testing for structural change in conditional models , 2000 .

[8]  Helmut Lütkepohl,et al.  Estimating Orthogonal Impulse Responses via Vector Autoregressive Models , 1991, Econometric Theory.

[9]  Francis X. Diebold,et al.  Measuring Predictability: Theory and Macroeconomic Applications , 1997 .

[10]  H. White.  A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity , 1980 .

[11]  H. White.  Asymptotic theory for econometricians , 1985 .

[12]  Helmut Lütkepohl,et al.  Testing for Causation Using Infinite Order Vector Autoregressive Processes , 1996, Econometric Theory.

[13]  D. Andrews.  Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation , 1991 .

[14]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[15]  EFFICIENT IV ESTIMATION FOR AUTOREGRESSIVE MODELS WITH CONDITIONAL HETEROSKEDASTICITY , 2002, Econometric Theory.

[16]  Yongmiao Hong,et al.  Consistent Testing for Serial Correlation of Unknown Form , 1996 .

[17]  Regina Y. Liu.  Bootstrap Procedures under some Non-I.I.D. Models , 1988 .

[18]  K. Berk.  Consistent Autoregressive Spectral Estimates , 1974 .

[19]  H. White,et al.  Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models , 2000 .

[20]  N. Davies.  Multiple Time Series , 2005 .

[21]  Peter Bühlmann,et al.  Moving-average representation of autoregressive approximations , 1995 .

[22]  R. Serfling.  Approximation Theorems of Mathematical Statistics , 1980 .

[23]  R. Bhansali.  Linear Prediction by Autoregressive Model Fitting in the Time Domain , 1978 .

[24]  Lutz Kilian,et al.  Bootstrapping Smooth Functions of Slope Parameters and Innovation Variances in VAR(∞) Models , 2002 .

[25]  E. Paparoditis.  Bootstrapping Autoregressive and Moving Average Parameter Estimates of Infinite Order Vector Autoregressive Processes , 1996 .

[26]  V. Solo.  The Statistical Theory of Linear Systems E. J. Hannan and Manfred Deistler John Wiley & Sons, 1988 , 1992, Econometric Theory.

[27]  R. Luukkonen,et al.  Testing cointegration in infinite order vector autoregressive processes , 1997 .

[28]  H. Lütkepohl.  Prediction tests for structural stability , 1988 .

[29]  C. F. Wu.  JACKKNIFE , BOOTSTRAP AND OTHER RESAMPLING METHODS IN REGRESSION ANALYSIS ' BY , 2008 .

[30]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[31]  John W. Galbraith,et al.  Content horizons for univariate time-series forecasts , 2003 .

[32]  P. Bühlmann.  Sieve bootstrap for time series , 1997 .

[33]  H. Lütkepohl.  Asymptotic Distribution of the Moving Average Coefficients of an Estimated Vector Autoregressive Process , 1988, Econometric Theory.

[34]  Serena Ng,et al.  Unit Root Tests in ARMA Models with Data-Dependent Methods for the Selection of the Truncation Lag , 1995 .

[35]  R. Hodrick.  Dividend Yields and Expected Stock Returns: Alternative Procedures for Interference and Measurement , 1991 .

[36]  Bootstrap confidence regions computed from autoregressions of arbitrary order , 2000 .

[37]  Adrian Pagan,et al.  Heteroscedasticity in Models with Lagged Dependent Variables , 1983 .

[38]  D. Brillinger.  Time series - data analysis and theory , 1981, Classics in applied mathematics.

[39]  S. Geman,et al.  Nonparametric Maximum Likelihood Estimation by the Method of Sieves , 1982 .

[40]  E. Hannan,et al.  The statistical theory of linear systems , 1989 .

[41]  Politis,et al.  [Springer Series in Statistics] Subsampling || Subsampling for Stationary Time Series , 1999 .

[42]  Lutz Kilian,et al.  Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form , 2002, SSRN Electronic Journal.

[43]  F. Eicker.  Asymptotic Normality and Consistency of the Least Squares Estimators for Families of Linear Regressions , 1963 .

[44]  C. Sims,et al.  Vector Autoregressions , 1999 .

[45]  E. Mammen.  Bootstrap and Wild Bootstrap for High Dimensional Linear Models , 1993 .

[46]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[47]  G. Reinsel,et al.  Prediction of multivariate time series by autoregressive model fitting , 1985 .

[48]  P. McCullagh.  Tensor Methods in Statistics , 1987 .

[49]  Pentti Saikkonen,et al.  Estimation and Testing of Cointegrated Systems by an Autoregressive Approximation , 1992, Econometric Theory.

[50]  J. Davidson.  Stochastic Limit Theory , 1994 .

[51]  A. A. Weiss.  ARMA MODELS WITH ARCH ERRORS , 1984 .

[52]  G. Kuersteiner.  Optimal Instrumental Variables Estimation for Arma Models , 1999 .

[53]  Helmut Lütkepohl,et al.  Impulse response analysis in infinite order cointegrated vector autoregressive processes , 1997 .

[54]  Guido M. Kuersteiner,et al.  Efficiency IV Estimation for Autoregressive Models with Conditional Heterogeneity , 2000 .

[55]  E. Giné,et al.  Bootstrapping General Empirical Measures , 1990 .

[56]  J. Fox.  Bootstrapping Regression Models , 2002 .

[57]  H. Lütkepohl,et al.  Infinite-Order Cointegrated Vector Autoregressive Processes , 1996, Econometric Theory.