Optimal difference-based variance estimators in time series: A general framework

Variance estimation is important for statistical inference. It becomes non-trivial when observations are masked by serial dependence structures and time-varying mean structures. Existing methods either ignore or suboptimally handle these nuisance structures. This paper develops a general framework for the estimation of the long-run variance for time series with non-constant means. The building blocks are difference statistics. The proposed class of estimators is general enough to cover many existing estimators. Necessary and sufficient conditions for consistency are investigated. The first asymptotically optimal estimator is derived. Our proposed estimator is theoretically proven to be invariant to arbitrary mean structures, which may include trends and a possibly divergent number of discontinuities.

[1]  Zhijie Xiao,et al.  Tests for changing mean with monotonic power , 2009 .

[2]  Arnold J Stromberg,et al.  Subsampling , 2001, Technometrics.

[3]  X. Shao,et al.  Self-Normalization for Time Series: A Review of Recent Developments , 2015 .

[4]  E. Parzen.  On Consistent Estimates of the Spectrum of a Stationary Time Series , 1957 .

[5]  W. Newey,et al.  A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelationconsistent Covariance Matrix , 1986 .

[6]  C. Crainiceanu,et al.  Nonmonotonic power for tests of a mean shift in a time series , 2001 .

[7]  Axel Munk,et al.  Autocovariance Estimation in Regression with a Discontinuous Signal and m‐Dependent Errors: A Difference‐Based Approach , 2015, 1507.02485.

[8]  Peter D. Welch,et al.  On the relationship between batch means, overlapping means and spectral estimation , 1987, WSC '87.

[9]  Ting Zhang,et al.  Unsupervised Self-Normalized Change-Point Testing for Time Series , 2018 .

[10]  E. Carlstein.  The Use of Subseries Values for Estimating the Variance of a General Statistic from a Stationary Sequence , 1986 .

[11]  J. Steinebach,et al.  Testing for Changes in Multivariate Dependent Observations with an Application to Temperature Changes , 1999 .

[12]  B. Schmeiser,et al.  Optimal mean-squared-error batch sizes , 1995 .

[13]  Piotr Kokoszka,et al.  Change point detection in heteroscedastic time series , 2018, Econometrics and Statistics.

[14]  M. Levine,et al.  ACF estimation via difference schemes for a semiparametric model with $m$-dependent errors , 2019 .

[15]  Zhibiao Zhao.  A self-normalized confidence interval for the mean of a class of nonstationary processes. , 2011, Biometrika.

[16]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[17]  Herold Dehling,et al.  A robust method for shift detection in time series , 2015, Biometrika.

[18]  Zuofeng Shang,et al.  Variance Change Point Detection Under a Smoothly-Changing Mean Trend with Application to Liver Procurement , 2018, Journal of the American Statistical Association.

[19]  H. Künsch.  The Jackknife and the Bootstrap for General Stationary Observations , 1989 .

[20]  James M. Flegal,et al.  Lugsail lag windows for estimating time-average covariance matrices , 2021, Biometrika.

[21]  Joseph P. Romano,et al.  BIAS‐CORRECTED NONPARAMETRIC SPECTRAL ESTIMATION , 1995 .

[22]  M. Wand,et al.  An Effective Bandwidth Selector for Local Least Squares Regression , 1995 .

[23]  T. Cipra.  Statistical Analysis of Time Series , 2010 .

[24]  Bruce W. Schmeiser,et al.  Overlapping batch means: something for nothing? , 1984, WSC '84.

[25]  H. White.  Asymptotic theory for econometricians , 1985 .

[26]  X. Shao,et al.  A self‐normalized approach to confidence interval construction in time series , 2010, 1005.2137.

[27]  Wei Biao Wu,et al.  STRONG INVARIANCE PRINCIPLES FOR DEPENDENT RANDOM VARIABLES , 2007, 0711.3674.

[28]  Filippo Altissimo,et al.  Strong Rules for Detecting the Number of Breaks in a Time Series , 2003 .

[29]  W. Newey,et al.  A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelationconsistent Covariance Matrix , 1986 .

[30]  Nuisance-parameter-free changepoint detection in non-stationary series , 2018, TEST.

[31]  W. Wu,et al.  Asymptotic theory for stationary processes , 2011 .

[32]  P. Phillips,et al.  Testing Mean Stability of Heteroskedastic Time Series , 2015 .

[33]  P. Hall,et al.  Asymptotically optimal difference-based estimation of variance in nonparametric regression , 1990 .

[34]  H. Dette,et al.  Multiscale change point detection for dependent data , 2018, Scandinavian Journal of Statistics.

[35]  Weidong Liu,et al.  ASYMPTOTICS OF SPECTRAL DENSITY ESTIMATES , 2009, Econometric Theory.

[36]  I. Ibragimov,et al.  Some Limit Theorems for Stationary Processes , 1962 .

[37]  James R. Wilson,et al.  Overlapping Batch Means: Something more for Nothing? , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[38]  Change point analysis in non-stationary processes - a mass excess approach , 2018, 1801.09874.

[39]  Kin Wai Chan,et al.  Automatic Optimal Batch Size Selection for Recursive Estimators of Time-Average Covariance Matrix , 2017 .

[40]  M. Rosenblatt.  A CENTRAL LIMIT THEOREM AND A STRONG MIXING CONDITION. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Kin Wai Chan,et al.  High‐order Corrected Estimator of Asymptotic Variance with Optimal Bandwidth , 2017 .

[42]  R. C. Bradley.  Basic properties of strong mixing conditions. A survey and some open questions , 2005, math/0511078.

[43]  J. Rice.  Bandwidth Choice for Nonparametric Regression , 1984 .

[44]  WU WEIBIAO.  A TEST FOR DETECTING CHANGES IN MEAN , .

[45]  D. Andrews.  Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation , 1991 .

[46]  M. Woodroofe,et al.  Isotonic regression: Another look at the changepoint problem , 2001 .

[47]  L. Horváth,et al.  Limit Theorems in Change-Point Analysis , 1997 .

[48]  Wei Biao Wu,et al.  Inference of trends in time series , 2007 .

[49]  D. Politis.  HIGHER-ORDER ACCURATE, POSITIVE SEMIDEFINITE ESTIMATION OF LARGE-SAMPLE COVARIANCE AND SPECTRAL DENSITY MATRICES , 2005, Econometric Theory.

[50]  Philippe Soulier,et al.  Dependence in Probability and Statistics , 2006 .

[51]  Chun Yip Yau,et al.  New recursive estimators of the time-average variance constant , 2016, Stat. Comput..

[52]  W. Wu,et al.  Nonlinear system theory: another look at dependence. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Weining Wang,et al.  Inference of Breakpoints in High-dimensional Time Series , 2021, Journal of the American Statistical Association.

[54]  Ignacio N. Lobato.  Testing That a Dependent Process Is Uncorrelated , 2001 .

[55]  Kin Wai Chan.  Mean-Structure and Autocorrelation Consistent Covariance Matrix Estimation , 2020, Journal of Business & Economic Statistics.

[56]  H. White,et al.  THE BOOTSTRAP OF THE MEAN FOR DEPENDENT HETEROGENEOUS ARRAYS , 2001, Econometric Theory.