The extended nearest neighbor classification

The k-nearest neighbor classification rule (k-NNR) is among the most popular and successful pattern classification techniques. However, it usually suffers from the existing outliers, and in the small training samples situation, it performed poor. In this paper, a variant of the k-NNR, the extended nearest neighbor classification based on the local mean vector and the class mean vector has been proposed. The proposed classification method overcomes the influence of the existing outliers and performs obviously well than the traditional k-NNR in terms of the classification error rate on the unknown patterns.

[1]  Enrique Vidal,et al.  A class-dependent weighted dissimilarity measure for nearest neighbor classification problems , 2000, Pattern Recognit. Lett..

[2]  Kohji Fukunaga,et al.  Introduction to Statistical Pattern Recognition-Second Edition , 1990 .

[3]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[4]  Francesco Ricci,et al.  Data Compression and Local Metrics for Nearest Neighbor Classification , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Nicholas Kalouptsidis,et al.  Nearest neighbor pattern classification neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[6]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[7]  Robert Tibshirani,et al.  Discriminant Adaptive Nearest Neighbor Classification and Regression , 1995, NIPS.

[8]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[9]  Anil K. Jain,et al.  Classifier design with Parzen Windows , 1988 .

[10]  Yoshihiko Hamamoto,et al.  A local mean-based nonparametric classifier , 2006, Pattern Recognit. Lett..

[11]  Francesc J. Ferri,et al.  Considerations about sample-size sensitivity of a family of edited nearest-neighbor rules , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[12]  I. Tomek.  An Experiment with the Edited Nearest-Neighbor Rule , 1976 .

[13]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[14]  T. Wagner,et al.  Another Look at the Edited Nearest Neighbor Rule. , 1976 .

[15]  John Van Ness,et al.  On the dominance of non-parametric Bayes rule discriminant algorithms in high dimensions , 1980, Pattern Recognit..

[16]  Robert Tibshirani,et al.  Discriminant Adaptive Nearest Neighbor Classification , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ron Kohavi,et al.  The Utility of Feature Weighting in Nearest-Neighbor Algorithms , 1997 .

[18]  Enrique Vidal,et al.  Learning prototypes and distances (LPD). A prototype reduction technique based on nearest neighbor error minimization , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..