论文信息 - Supervised Machine Learning with a Novel Kernel Density Estimator

Supervised Machine Learning with a Novel Kernel Density Estimator

In recent years, kernel density estimation has been exploited by computer scientists to model machine learning problems. The kernel density estimation based approaches are of interest due to the low time complexity of either O(n) or O(n*log(n)) for constructing a classifier, where n is the number of sampling instances. Concerning design of kernel density estimators, one essential issue is how fast the pointwise mean square error (MSE) and/or the integrated mean square error (IMSE) diminish as the number of sampling instances increases. In this article, it is shown that with the proposed kernel function it is feasible to make the pointwise MSE of the density estimator converge at O(n^-2/3) regardless of the dimension of the vector space, provided that the probability density function at the point of interest meets certain conditions.

[1] E. Parzen. On Estimation of a Probability Density Function and Mode , 1962 .

[2] E. Artin,et al. The Gamma Function , 1964 .

[3] Jon Louis Bentley,et al. Multidimensional binary search trees used for associative searching , 1975, CACM.

[4] L. Breiman,et al. Variable Kernel Estimates of Multivariate Densities , 1977 .

[5] B. Silverman. Density estimation for statistics and data analysis , 1986 .

[6] David G. Lowe,et al. Similarity Metric Learning for a Variable-Kernel Classifier , 1995, Neural Computation.

[7] Adam Krzyzak,et al. Nonparametric estimation and classification using radial basis function nets and empirical risk minimization , 1996, IEEE Trans. Neural Networks.

[8] Nello Cristianini,et al. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[9] Stephan R. Sain,et al. Zero‐Bias Locally Adaptive Density Estimators , 2002 .

[10] Yen-Jen Oyang,et al. Data classification with radial basis function networks based on a novel kernel density estimation algorithm , 2005, IEEE Transactions on Neural Networks.

[11] Yen-Jen Oyang,et al. Prediction of Protein Secondary Structures with a Novel Kernel Density Estimator , 2007, MLMTA.