Consistency of Robust Kernel Density Estimators

The kernel density estimator (KDE) based on a radial positive-semiden ite kernel may be viewed as a sample mean in a reproducing kernel Hilbert space. This mean can be viewed as the solution of a least squares problem in that space. Replacing the squared loss with a robust loss yields a robust kernel density estimator (RKDE). Previous work has shown that RKDEs are weighted kernel density estimators which have desirable robustness properties. In this paper we establish asymptotic L 1 consistency of the RKDE for a class of losses and show that the RKDE converges with the same rate on bandwidth required for the traditional KDE. We also present a novel proof of the consistency of the traditional KDE.

[1]  B. Silverman,et al.  Weak and Strong Uniform Consistency of the Kernel Estimate of a Density and its Derivatives , 1978 .

[2]  Clayton D. Scott,et al.  Robust kernel density estimation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[4]  Lorenzo Rosasco,et al.  On regularization algorithms in learning theory , 2007, J. Complex..

[5]  I. Pinelis.  OPTIMUM BOUNDS FOR THE DISTRIBUTIONS OF MARTINGALES IN BANACH SPACES , 1994, 1208.2200.

[6]  Uwe Einmahl,et al.  An Empirical Process Approach to the Uniform Consistency of Kernel-Type Function Estimators , 2000 .

[7]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[8]  W. Stute.  A Law of the Logarithm for Kernel Density Estimators , 1982 .

[9]  Don R. Hush,et al.  Radial kernels and their reproducing kernel Hilbert spaces , 2010, J. Complex..

[10]  J. Simonoff.  Multivariate Density Estimation , 1996 .

[11]  E. Giné,et al.  Rates of strong uniform consistency for multivariate kernel density estimators , 2002 .

[12]  Joel Zinn,et al.  Weighted uniform consistency of kernel density estimators , 2004 .

[13]  Paul Deheuvels,et al.  Uniform Limit Laws for Kernel Density Estimators on Possibly Unbounded Intervals , 2000 .

[14]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[15]  A. Caponnetto,et al.  Optimal Rates for the Regularized Least-Squares Algorithm , 2007, Found. Comput. Math..

[16]  S. Smale,et al.  Learning Theory Estimates via Integral Operators and Their Approximations , 2007 .

[17]  Luc Devroye,et al.  Combinatorial methods in density estimation , 2001, Springer series in statistics.

[18]  Dominik Wied,et al.  Consistency of the kernel density estimator: a survey , 2012 .