On variance estimation under shifts in the mean

In many situations, it is crucial to estimate the variance properly. Ordinary variance estimators perform poorly in the presence of shifts in the mean. We investigate an approach based on non-overlapping blocks, which yields good results in change-point scenarios. We show the strong consistency and the asymptotic normality of such blocks-estimators of the variance under independence. Weak consistency is shown for short-range dependent strictly stationary data. We provide recommendations on the appropriate choice of the block size and compare this blocks-approach with difference-based estimators. If level shifts occur frequently and are rather large, the best results can be obtained by adaptive trimming of the blocks.

[1]  R. H. Kent,et al.  The Mean Square Successive Difference , 1941 .

[2]  H. O. Posten Multidimensional Gaussian Distributions , 1964 .

[3]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[4]  Ing Rj Ser Approximation Theorems of Mathematical Statistics , 1980 .

[5]  R. Serfling Approximation Theorems of Mathematical Statistics , 1980 .

[6]  F. Hassan Historical nile floods and their implications for climatic change. , 1981, Science.

[7]  J. Rice Bandwidth Choice for Nonparametric Regression , 1984 .

[8]  T. Gasser,et al.  Residual variance and residual pattern in nonlinear regression , 1986 .

[9]  Ferenc Móricz,et al.  Strong laws of large numbers for arrays of rowwise independent random variables , 1989 .

[10]  P. Hall,et al.  Asymptotically optimal difference-based estimation of variance in nonparametric regression , 1990 .

[11]  Laurie Davies,et al.  The identification of multiple outliers , 1993 .

[12]  K. Hipel,et al.  Time series modelling of water resources and environmental systems , 1994 .

[13]  Holger Dette,et al.  Estimating the variance in nonparametric regression—what is a reasonable choice? , 1998 .

[14]  Nicolai Bissantz,et al.  On difference‐based variance estimation in nonparametric regression when the covariate is high dimensional , 2005 .

[15]  J. Syvitski,et al.  Morphodynamics of deltas under the influence of humans , 2007 .

[16]  J. Fox,et al.  Applied Regression Analysis and Generalized Linear Models , 2008 .

[17]  Tiejun Tong,et al.  Optimal variance estimation without estimating the mean function , 2013, 1312.3046.

[18]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[19]  Tiejun Tong,et al.  Variance estimation in nonparametric regression with jump discontinuities , 2014 .

[20]  Axel Munk,et al.  Autocovariance Estimation in Regression with a Discontinuous Signal and m‐Dependent Errors: A Difference‐Based Approach , 2015, 1507.02485.

[21]  Lixing Zhu,et al.  Difference-based variance estimation in nonparametric regression with repeated measurement data , 2015 .

[22]  S. Meintanis,et al.  Fourier methods for analyzing piecewise constant volatilities , 2017 .

[23]  Lu Lin,et al.  Optimal variance estimation based on lagged second-order difference in nonparametric regression , 2017, Comput. Stat..

[24]  Claudia Kirch,et al.  A MOSUM procedure for the estimation of multiple random change points , 2018 .

[25]  Roland Fried,et al.  Estimation methods for the LRD parameter under a change in the mean , 2019 .