Local likelihood method: a bridge over parametric and nonparametric regression

This paper discusses local likelihood method for estimating a regression function in a setting which includes generalized linear models. The local likelihood function is constructed by first considering a parametric model for the regression function. It is defined as a locally weighted log-likelihood with weights determined by a kernel function and a bandwidth. When a large bandwidth is chosen, the resulting estimator would be close to the fully parametric maximum likelihood estimator, so that a large bandwidth would be a relevant choice in the case where the true regression function is near the parametric family. On the other hand, when a small bandwidth is chosen, the performance of the resulting estimator would not depend much on the assumed parametric model, thus a small bandwidth would be desirable if the parametric model is largely misspecified. In this paper, we detail the way in which the risk of the local likelihood estimator is affected by bandwidth selection and model misspecification. We derive explicit formulas for the bias and variance of the local likelihood estimator for both large and small bandwidths. We look into higher order asymptotic expansions for the risk of the local likelihood estimator in the case where the bandwidth is large, which enables us to determine the optimal size of the bandwidth depending on the degree of model misspecification.

[1]  G. Claeskens,et al.  Testing lack of fit in multiple regression , 2000 .

[2]  E. Mammen,et al.  Comparing Nonparametric Versus Parametric Regression Fits , 1993 .

[3]  Jianqing Fan,et al.  Local polynomial kernel regression for generalized linear models and quasi-likelihood functions , 1995 .

[4]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[5]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[6]  James Stephen Marron,et al.  Comparison of data-driven bandwith selectors , 1988 .

[7]  R. Tibshirani,et al.  Local Likelihood Estimation , 1987 .

[8]  Elias Masry,et al.  Multivariate regression estimation: local polynomial fitting for time series , 1997 .

[9]  James K. Lindsey,et al.  Parametric Statistical Inference , 1996 .

[10]  M. C. Jones,et al.  Locally parametric nonparametric density estimation , 1996 .

[11]  J. B. Copas,et al.  Local Likelihood Based on Kernel Censoring , 1995 .

[12]  Shinto Eguchi,et al.  A class of local likelihood methods and near‐parametric asymptotics , 1998 .

[13]  M. C. Jones,et al.  A reliable data-based bandwidth selection method for kernel density estimation , 1991 .

[14]  C. Loader.  Local Likelihood Density Estimation , 1996 .

[15]  On local likelihood density estimation , 2002 .

[16]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[17]  J. Doob.  Stochastic processes , 1953 .

[18]  G. Claeskens,et al.  Testing the Fit of a Parametric Function , 1999 .