Relative efficiencies of kernel and local likelihood density estimators

Local likelihood methods enjoy advantageous properties, such as good performance in the presence of edge effects, that are rarely found in other approaches to nonparametric density estimation. However, as we argue in this paper, standard kernel methods can have distinct advantages when edge effects are not present. We show that, whereas the integrated variances of the two methods are virtually identical, the integrated squared bias of a conventional kernel estimator is less than that of a local log-linear estimator by as much as a factor of 4. Moreover, the greatest bias improvements offered by kernel methods occur when they are needed most-i.e. when the effect of bias is particularly high. Similar comparisons can also be made when high degree local log-polynomial fits are assessed against high order kernel methods. For example, although (as is well known) high degree local polynomial fits offer potentially infinite efficiency gains relative to their kernel competitors, the converse is also true. Indeed, the asymptotic value of the integrated squared bias of a local log-quadratic estimator can exceed any given constant multiple of that for the competing kernel method. In all cases the densities that suffer problems in the context of local log-likelihood methods can be chosen to be symmetric, either unimodal or bimodal, either infinitely or compactly supported, and to have arbitrarily many derivatives as functions on the real line. They are not pathological. However, our results reveal quantitative differences between global performances of local log-polynomial estimators applied to unimodal or multimodal distributions. Copyright 2002 Royal Statistical Society.

[1]  J. Simonoff Smoothing Methods in Statistics , 1998 .

[2]  J. Simonoff Three Sides of Smoothing: Categorical Data Smoothing, Nonparametric Regression, and Density Estimation , 1998 .

[3]  J. Simonoff,et al.  Transformation- based density estimation For weighted distributions , 2000 .

[4]  M. C. Jones,et al.  Simple boundary correction for kernel density estimation , 1993 .

[5]  Daren B. H. Cline,et al.  Kernel Estimation of Densities with Discontinuities or Discontinuous Derivatives , 1991 .

[6]  B. Turlach,et al.  High-derivative parametric enhancements of nonparametric curve estimators , 1999 .

[7]  Shinto Eguchi,et al.  A class of local likelihood methods and near‐parametric asymptotics , 1998 .

[8]  Normalité asymptotique de l'estimateur par polynômes locaux de la densité et ses dérivées pour des processus réels et mélangeants , 1999 .

[9]  J. B. Copas,et al.  Local Likelihood Based on Kernel Censoring , 1995 .

[10]  C. Loader Local Likelihood Density Estimation , 1996 .

[11]  H. Müller,et al.  Kernels for Nonparametric Curve Estimation , 1985 .

[12]  R A Betensky,et al.  Multiple imputation for simple estimation of the hazard function based on interval censored data. , 2000, Statistics in medicine.

[13]  Theo Gasser,et al.  Finite-Sample Variance of Local Polynomials: Analysis and Solutions , 1996 .

[14]  M. C. Jones,et al.  An Improved Estimator of the Density Function at the Boundary , 1999 .

[15]  Estimation non paramétrique de la densité d'un processus stationnaire mélangeant , 2001 .

[16]  M. Wand,et al.  Local EM Estimation of the Hazard Function for Interval‐Censored Data , 1999, Biometrics.

[17]  M. C. Jones,et al.  Locally parametric nonparametric density estimation , 1996 .

[18]  Peter Hall,et al.  On Pseudodata Methods for Removing Boundary Effects in Kernel Density Estimation , 1996 .

[19]  Jianqing Fan,et al.  Local maximum likelihood estimation and inference , 1998 .

[20]  W. Cleveland Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[21]  Peter Hall,et al.  On the shrinkage of local linear curve estimators , 1997, Stat. Comput..

[22]  H. Müller Boundary Effects in Nonparametric Curve Estimation Models , 1984 .

[23]  M. C. Jones,et al.  A SIMPLE NONNEGATIVE BOUNDARY CORRECTION METHOD FOR KERNEL DENSITY ESTIMATION , 1996 .

[24]  M. Wand,et al.  EXACT MEAN INTEGRATED SQUARED ERROR , 1992 .

[25]  M. C. Jones,et al.  A Comparison of Higher-Order Bias Kernel Density Estimators , 1997 .

[26]  Timothy S. Murphy,et al.  Harmonic Analysis: Real-Variable Methods, Orthogonality, and Oscillatory Integrals , 1993 .

[27]  Rebecca A. Betensky,et al.  Local Likelihood Analysis of Survival Data With Censored Intermediate Events , 2001 .