The condensed fuzzy k-nearest neighbor rule based on sample fuzzy entropy

The fuzzy k-nearest neighbor (F-KNN) algorithm was originally developed by Keller in 1985, which generalized the k-nearest neighbor (KNN) algorithm and could overcome the drawback of KNN in which all of instances were considered equally important. However, the F-KNN algorithm still suffers from the problem of large memory requirement same as the KNN. In order to deal with the problem, this paper proposes the condensed fuzzy k-nearest neighbor rule (CFKNN) which selects the important instances based on sample fuzzy entropy. The experimental results show that our proposed method is feasible and effective.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[3]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[4]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[5]  Jun-Hai Zhai,et al.  Fuzzy decision tree based on fuzzy-rough technique , 2011, Soft Comput..

[6]  Belur V. Dasarathy,et al.  Nearest neighbor (NN) norms: NN pattern classification techniques , 1991 .

[7]  Li-Juan Wang,et al.  An improved multiple fuzzy NNC system based on mutual information and fuzzy integral , 2011, Int. J. Mach. Learn. Cybern..

[8]  C. L. Philip Chen,et al.  Adaptive least squares support vector machines filter for hand tremor canceling in microsurgery , 2011, Int. J. Mach. Learn. Cybern..

[9]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[11]  Peter E. Hart,et al.  The condensed nearest neighbor rule (Corresp.) , 1968, IEEE Trans. Inf. Theory.

[12]  Dan Roth,et al.  Margin-based active learning for structured predictions , 2010, Int. J. Mach. Learn. Cybern..

[13]  Xizhao Wang,et al.  Induction of multiple fuzzy decision trees based on rough set technique , 2008, Inf. Sci..

[14]  C. G. Hilborn,et al.  The Condensed Nearest Neighbor Rule , 1967 .