An iterated Cochrane-Orcutt procedure for nonparametric regression

Altman (1990) and Hart (1991) have shown that kernel regression can be an effective method for estimating an unknown mean function when the errors are correlated. However, the optimal bandwidth for kernel smoothing depends strongly on the correlation function, as do confidence bands for the regression curve. In this paper, the simultaneous estimation of the regression and correlation functions is explored. An iterative technique analogous to the iterated Cochrane-Orcutt method for linear regression (Cochrane and Orcutt, 1949) is shown to perform well. However, for moderate sample sizes, stopping after the first iteration produces better results. An interesting feature of the simultaneous method is that it performs best when different kernels are used to estimate the regression and correlation functions. For the regression function, unimodal kernels are known to be optimal. However, examination of the mean squared error of the correlation estimator suggests that a bimodal kernel will perform better for est...

[1]  A. A. Weiss,et al.  Semiparametric estimates of the relation between weather and electricity sales , 1986 .

[2]  Naomi Altman,et al.  Kernel Smoothing of Data with Correlated Errors , 1990 .

[3]  M. Priestley,et al.  Non‐Parametric Function Fitting , 1972 .

[4]  D. Cochrane,et al.  Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms , 1949 .

[5]  P. Lewis,et al.  A 40–50 day oscillation in sea-surface temperature along the central California coast , 1988 .

[6]  B. Silverman,et al.  Spline Smoothing: The Equivalent Variable Kernel Method , 1984 .

[7]  Shean-Tsong Chiu,et al.  Bandwidth selection for kernel estimate with correlated noise , 1989 .

[8]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[9]  B. Silverman,et al.  Some Aspects of the Spline Smoothing Approach to Non‐Parametric Regression Curve Fitting , 1985 .

[10]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[11]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[12]  M. Bartlett.  On the Theoretical Specification and Sampling Properties of Autocorrelated Time‐Series , 1946 .

[13]  Young K. Truoung.  Nonparametric curve estimation with time series errors , 1992 .

[14]  M. Hutchinson,et al.  ON SPLINE SMOOTHING WITH AUTOCORRELATED ERRORS , 1989 .

[15]  H. Akaike.  A new look at the statistical model identification , 1974 .

[16]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[17]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[18]  T. Gasser,et al.  A Flexible and Fast Method for Automatic Smoothing , 1991 .

[19]  Theo Gasser,et al.  Smoothing Techniques for Curve Estimation , 1979 .

[20]  Young K. Truong,et al.  Nonparametric curve estimation with time series errors , 1991 .