A Fully Automated Bandwidth Selection Method for Fitting Additive Models

Abstract This article describes a fully automated bandwidth selection method for additive models that is applicable to the widely used backfitting algorithm of Buja, Hastie, and Tibshirani. The proposed plug-in estimator is an extension of the univariate local linear regression estimator of Ruppert, Sheather, and Wand and is shown to achieve the same Op (n –2/7) relative convergence rate for bivariate additive models. If more than two covariates are present, theoretical justification of the method requires independence of the covariates, but simulation experiments show that in practice the method is very robust to violations of this assumption. The proposed bandwidth selection method is compared to cross-validation through simulation experiments. Its practical behavior is demonstrated on a real dataset.

[1]  Jianqing Fan,et al.  Data‐Driven Bandwidth Selection in Local Polynomial Fitting: Variable Bandwidth and Spatial Adaptation , 1995 .

[2]  R. Tibshirani,et al.  Linear Smoothers and Additive Models , 1989 .

[3]  J. Marron,et al.  On variance estimation in nonparametric regression , 1990 .

[4]  Jianqing Fan,et al.  Fast Implementations of Nonparametric Curve Estimators , 1994 .

[5]  David Ruppert,et al.  Fitting a Bivariate Additive Model by Local Polynomial Regression , 1997 .

[6]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[7]  David E. Booth,et al.  Seeing a curve in multiple regression , 1995 .

[8]  M. Wand,et al.  Multivariate Locally Weighted Least Squares Regression , 1994 .

[9]  David A. Belsley,et al.  Regression Analysis and its Application: A Data-Oriented Approach.@@@Applied Linear Regression.@@@Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1981 .

[10]  M. C. Jones,et al.  On optimal data-based bandwidth selection in kernel density estimation , 1991 .

[11]  W. Härdle,et al.  How Far are Automatically Chosen Regression Smoothing Parameters from their Optimum , 1988 .

[12]  D. Ruppert.  Empirical-Bias Bandwidths for Local Polynomial Nonparametric Regression and Density Estimation , 1997 .

[13]  Jianqing Fan,et al.  Fast implementations of nonparametric curve estimators , 1993 .

[14]  Chong Gu,et al.  Minimizing GCV/GML Scores with Multiple Smoothing Parameters via the Newton Method , 1991, SIAM J. Sci. Comput..

[15]  Trevor Hastie,et al.  Statistical Models in S , 1991 .

[16]  D. J. Donnell,et al.  Analysis of Additive Dependencies and Concurvities Using Smallest Additive Principal Components , 1994 .

[17]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[18]  M. Wand,et al.  An Effective Bandwidth Selector for Local Least Squares Regression , 1995 .

[19]  D. Rubinfeld,et al.  Hedonic housing prices and the demand for clean air , 1978 .

[20]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[21]  J. Friedman,et al.  Estimating Optimal Transformations for Multiple Regression and Correlation. , 1985 .