Local Likelihood Estimation in Generalized Additive Models

Generalized additive models are a popular class of multivariate non-parametric regression models, due in large part to the ease of use of the local scoring estimation algorithm. However, the theoretical properties of the local scoring estimator are poorly understood. In this article, we propose a local likelihood estimator for generalized additive models that is closely related to the local scoring estimator fitted by local polynomial regression. We derive the statistical properties of the estimator and show that it achieves the same asymptotic convergence rate as a one-dimensional local polynomial regression estimator. We also propose a wild bootstrap estimator for calculating point-wise confidence intervals for the additive component functions. The practical behaviour of the proposed estimator is illustrated through a simulation experiment. Copyright 2003 Board of the Foundation of the Scandinavian Journal of Statistics..

[1]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[2]  Jianqing Fan,et al.  Local polynomial kernel regression for generalized linear models and quasi-likelihood functions , 1995 .

[3]  H. Müller,et al.  Estimating regression functions and their derivatives by the kernel method , 1984 .

[4]  David Ruppert,et al.  Local Estimating Equations , 1998 .

[5]  C. J. Stone,et al.  The Dimensionality Reduction Principle for Generalized Additive Models , 1986 .

[6]  Enno Mammen,et al.  The Existence and Asymptotic Properties of a Backfitting Projection Algorithm Under Weak Conditions , 1999 .

[7]  David Ruppert,et al.  Fitting a Bivariate Additive Model by Local Polynomial Regression , 1997 .

[8]  O. Linton,et al.  A kernel method of estimating structured nonparametric regression based on marginal integration , 1995 .

[9]  Göran Kauermann,et al.  BOOTSTRAP CONFIDENCE INTERVALS FOR LOCAL LIKELIHOOD, LOCAL ESTIMATING EQUATIONS AND VARYING COEFFICIENT MODELS , 2000 .

[10]  Jianqing Fan,et al.  Local maximum likelihood estimation and inference , 1998 .

[11]  David Ruppert,et al.  A Root-n Consistent Backfitting Estimator for Semiparametric Additive Modeling , 1999 .

[12]  Wolfgang Härdle,et al.  Direct estimation of low-dimensional components in additive models , 1998 .

[13]  Göran Kauermann,et al.  The efficiency of bias-corrected estimators for nonparametric kernel estimation based on local estimating equations , 1998 .

[14]  P. McCullagh.  Tensor Methods in Statistics , 1987 .

[15]  Oliver Linton,et al.  EFFICIENT ESTIMATION OF GENERALIZED ADDITIVE NONPARAMETRIC REGRESSION MODELS , 2000, Econometric Theory.

[16]  R. Tibshirani,et al.  Linear Smoothers and Additive Models , 1989 .

[17]  Gerhard Tutz,et al.  Local likelihood estimation in varying-coefficient models including additive bias correction , 2000 .

[18]  James Stephen Marron,et al.  BOOTSTRAP SIMULTANEOUS ERROR BARS FOR NONPARAMETRIC REGRESSION , 1991 .

[19]  W. Härdle,et al.  Estimation of additive regression models with known links , 1996 .

[20]  A. W. Davis.  Statistical distributions in univariate and multivariate Edgeworth populations , 1976 .

[21]  Gerda Claeskens,et al.  Some theory for penalized spline generalized additive models , 2002 .

[22]  Jean D. Opsomer,et al.  Asymptotic Properties of Backfitting Estimators , 2000 .

[23]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[24]  D. Pollard.  Convergence of stochastic processes , 1984 .

[25]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[26]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.