Correction of Density Estimators that are not Densities

Several old and new density estimators may have good theoretical performance, but are hampered by not being bona fide densities; they may be negative in certain regions or may not integrate to 1. One can therefore not simulate from them, for example. This paper develops general modification methods that turn any density estimator into one which is a bona fide density, and which is always better in performance under one set of conditions and arbitrarily close in performance under a complementary set of conditions. This improvement-for-free procedure can, in particular, be applied for higher-order kernel estimators, classes of modern "h"-super-4 bias kernel type estimators, superkernel estimators, the sinc kernel estimator, the "k"-NN estimator, orthogonal expansion estimators, and for various recently developed semi-parametric density estimators. Copyright Board of the Foundation of the Scandinavian Journal of Statistics 2003..

[1]  E. Nadaraya,et al.  On the Integral Mean Square Error of Some Nonparametric Estimates for the Density Function , 1974 .

[2]  R. Kronmal,et al.  The Estimation of Probability Densities and Cumulatives by Fourier Series Methods , 1968 .

[3]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[4]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[5]  Thomas J. DiCiccio,et al.  On Smoothing and the Bootstrap , 1989 .

[6]  Nouna Kettaneh,et al.  Statistical Modeling by Wavelets , 1999, Technometrics.

[7]  R. Tibshirani,et al.  Using specially designed exponential families for density estimation , 1996 .

[8]  Correcting the negativity of high-order kernel density estimators , 1993 .

[9]  Performance of Efron and Tibshirani's semiparametric density estimator , 1996 .

[10]  David W. Scott,et al.  On Improving Convergence Rates for Nonnegative Kernel Density Estimators , 1980 .

[11]  Marek Kaluszka,et al.  On the Devroye-Györfi methods of correcting density estimators , 1998 .

[12]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[13]  B. Silverman,et al.  On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood Method , 1982 .

[14]  Jens Perch Nielsen,et al.  A simple bias reduction method for density estimation , 1995 .

[15]  K. B. Davis,et al.  Mean Square Error Properties of Density Estimates , 1975 .

[16]  N. Hjort,et al.  Nonparametric Density Estimation with a Parametric Start , 1995 .

[17]  C. Small,et al.  Hilbert Space Methods in Probability and Statistical Inference , 1994 .

[18]  Lesław Gajek,et al.  On Improving Density Estimators which are not Bona Fide Functions , 1986 .

[19]  M. C. Jones,et al.  A Comparison of Higher-Order Bias Kernel Density Estimators , 1997 .

[20]  L. Devroye.  A Note on the Usefulness of Superkernels in Density Estimation , 1992 .

[21]  Christopher G. Small,et al.  Hilbert Space Methods in Probability and Statistical Inference: Small/Hilbert , 1994 .

[22]  M. C. Jones,et al.  Locally parametric nonparametric density estimation , 1996 .