Adaptive Efficient Weighted Least Squares With Dependent Observations

Work of Eicker [1963], Hinkley [1977] and White [1980] has established straightforward methods for consistently estimating the asymptotic covariance matrix of the ordinary least squares (OLS) estimator for the parameters of the linear regression model despite the possible presence of heteroskedasticity of unknown form. In this sense, such covariance matrix estimators are “robust” to unequal scale of the regression errors. Cragg [1983] proposed parameter estimators that exploit unknown heteroskedasticity to achieve gains in relative efficiency, in the sense that Cragg’s estimators have smaller asymptotic variance than OLS. However, Cragg’s estimators are not guaranteed to have minimum asymptotic variance, so the presence of heteroskedasticity of unknown form can still have adverse consequences for the power of tests based on these estimators.

[1]  D. McLeish Dependent Central Limit Theorems and Invariance Principles , 1974 .

[2]  H. Theil Principles of econometrics , 1971 .

[3]  W. Newey,et al.  Uniform Convergence in Probability and Stochastic Equicontinuity , 1991 .

[4]  Adrian Pagan,et al.  Heteroscedasticity in Models with Lagged Dependent Variables , 1983 .

[5]  Donald W. K. Andrews,et al.  An empirical process central limit theorem for dependent non-identically distributed random variables , 1989 .

[6]  D. Andrews Laws of Large Numbers for Dependent Non-Identically Distributed Random Variables , 1988, Econometric Theory.

[7]  F. Diebold Empirical modeling of exchange rate dynamics , 1988 .

[8]  R. Engle Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[9]  D. Edmunds,et al.  Fourier approximation and embeddings of Sobolev spaces , 1977 .

[10]  H. White A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity , 1980 .

[11]  P. Robinson Asymptotically efficient estimation in the presence of heteroskedasticity of unknown form , 1987 .

[12]  P. Billingsley,et al.  Probability and Measure , 1980 .

[13]  Maxwell B. Stinchcombe,et al.  Some Measurability Results for Extrema of Random Functions Over Random Sets , 1992 .

[14]  B. Malkiel A Random Walk Down Wall Street , 1973 .

[15]  F. Eicker Asymptotic Normality and Consistency of the Least Squares Estimators for Families of Linear Regressions , 1963 .

[16]  H. White,et al.  Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties☆ , 1985 .

[17]  D. Pollard Convergence of stochastic processes , 1984 .

[18]  Halbert White,et al.  Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings , 1990, Neural Networks.

[19]  D. Andrews Asymptotic Results for Generalized Wald Tests , 1987, Econometric Theory.

[20]  R. A. Silverman,et al.  Introductory Real Analysis , 1972 .

[21]  H. White Asymptotic theory for econometricians , 1985 .

[22]  J. G. Cragg MORE EFFICIENT ESTIMATION IN THE PRESENCE OF HETEROSCEDASTICITY OF UNKNOWN FORM , 1983 .

[23]  D. Hinkley Jackknifing in Unbalanced Situations , 1977 .

[24]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[25]  Andrew Donald Booth,et al.  Theory of the transmission and processing of information , 1961 .