Direct estimation of low-dimensional components in additive models

Additive regression models have turned out to be a useful statistical tool in analyses of high-dimensional data sets. Recently, an estimator of additive components has been introduced by Linton and Nielsen which is based on marginal integration. The explicit definition of this estimator makes possible a fast computation and allows an asymptotic distribution theory. In this paper an asymptotic treatment of this estimate is offered for several models. A modification of this procedure is introduced. We consider weighted marginal integration for local linear fits and we show that this estimate has the following advantages. (i) With an appropriate choice of the weight function, the additive components can be efficiently estimated: An additive component can be estimated with the same asymptotic bias and variance as if the other components were known. (ii) Application of local linear fits reduces the design related bias.

[1]  Wolfgang Härdle,et al.  Additive Nonparametric Regression on Principal Components , 1995 .

[2]  O. Linton,et al.  A kernel method of estimating structured nonparametric regression based on marginal integration , 1995 .

[3]  Jianqing Fan,et al.  Generalized Partially Linear Single-Index Models , 1997 .

[4]  P. K. Bhattacharya,et al.  Semiparametric inference in a partial linear model , 1997 .

[5]  H. Müller,et al.  Local Polynomial Modeling and Its Applications , 1998 .

[6]  Ernst R. Berndt,et al.  The Practice of Econometrics: Classic and Contemporary. , 1992 .

[7]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[8]  C. J. Stone,et al.  The Dimensionality Reduction Principle for Generalized Additive Models , 1986 .

[9]  Enno Mammen,et al.  The Existence and Asymptotic Properties of a Backfitting Projection Algorithm Under Weak Conditions , 1999 .

[10]  C. J. Stone,et al.  OPTIMAL UNIFORM RATE OF CONVERGENCE FOR NONPARAMETRIC ESTIMATORS OF A DENSITY FUNCTION OR ITS DERIVATIVES , 1983 .

[11]  David Ruppert,et al.  Fitting a Bivariate Additive Model by Local Polynomial Regression , 1997 .

[12]  W. Härdle,et al.  Estimation and Variable Selection in Additive Nonparametric Regression Models , 1995 .

[13]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[14]  Enno Mammen,et al.  Testing Parametric Versus Semiparametric Modelling in Generalized Linear Models , 1996 .

[15]  Jianqing Fan,et al.  Variable Bandwidth and Local Linear Regression Smoothers , 1992 .

[16]  Jianqing Fan.  Local Linear Regression Smoothers and Their Minimax Efficiencies , 1993 .

[17]  Oliver Linton,et al.  Miscellanea Efficient estimation of additive nonparametric regression models , 1997 .

[18]  B. Silverman,et al.  Weak and strong uniform consistency of kernel regression estimates , 1982 .

[19]  P. Speckman.  Kernel smoothing in partial linear models , 1988 .

[20]  Jean D. Opsomer,et al.  Asymptotic Properties of Backfitting Estimators , 2000 .

[21]  Dag Tjøstheim,et al.  Nonparametric Identification of Nonlinear Time Series: Projections , 1994 .

[22]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.