Asymptotic Properties of Backfitting Estimators

When additive models with more than two covariates are fitted with the backfitting algorithm proposed by Buja et al. [2], the lack of explicit expressions for the estimators makes study of their theoretical properties cumbersome. Recursion provides a convenient way to extend existing theoretical results for bivariate additive models to models of arbitrary dimension. In the case of local polynomial regression smoothers, recursive asymptotic bias and variance expressions for the backfitting estimators are derived. The estimators are shown to achieve the same rate of convergence as those of univariate local polynomial regression. In the case of independence between the covariates, non-recursive bias and variance expressions, as well as the asymptotically optimal values for the bandwidth parameters, are provided.

[1]  R. Tibshirani,et al.  Linear Smoothers and Additive Models , 1989 .

[2]  Robert Kohn,et al.  Convergence of the backfitting algorithm for additive models , 1994 .

[3]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[4]  G. Wahba,et al.  The computation of generalized cross-validation functions through householder tridiagonalization with applications to the fitting of interaction spline models , 1989 .

[5]  P. Hall,et al.  On the backfitting algorithm for additive regression models , 1993 .

[6]  David Ruppert,et al.  Fitting a Bivariate Additive Model by Local Polynomial Regression , 1997 .

[7]  M. Wand,et al.  Multivariate Locally Weighted Least Squares Regression , 1994 .

[8]  O. Linton,et al.  A kernel method of estimating structured nonparametric regression based on marginal integration , 1995 .

[9]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[10]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[11]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[12]  David Ruppert,et al.  A Fully Automated Bandwidth Selection Method for Fitting Additive Models , 1998 .

[13]  Wolfgang Härdle,et al.  Direct estimation of low-dimensional components in additive models , 1998 .

[14]  Trevor Hastie,et al.  Statistical Models in S , 1991 .

[15]  G. Wahba.  Partial and interaction spline models for the semiparametric estimation of functions of several variables , 1986 .