ParzenWindows Estimation Using Laplace Kernel: A Novel Parametric Analysis with Information Content

Parzen windows estimation is one of the classical non- parametric methods in the field of machine learning and pattern classification, and usually uses Gaussian density function as the kernel. Although the relation between the kernel density estimation (KDE) and low-pass filtering is well known, it is vary difficult to setting the parameters of the other kinds of density functions. This paper proposes a novel method to deal with the parameters of Laplace kernel through measuring the degree of exchanged information among interpolating points. Experimental results showed that the proposed method can improve the performance of Parzen windows significantly.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  Keinosuke Fukunaga,et al.  The Reduced Parzen Classifier , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[4]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[6]  Narendra Ahuja,et al.  Regression based bandwidth selection for segmentation using Parzen windows , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[8]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .