MFZ-KNN — A modified fuzzy based K nearest neighbor algorithm

KNN is amongst the simplest top ten classification algorithm of data mining. Being effective and efficient it has some drawbacks which cannot be overlooked. Moreover, real world data is fuzzy in nature. To overcome this drawback fuzzy KNN was introduced which was based on fuzzy membership. But, it had large time complexity as the membership is calculated at the classification period. To improve this, we have proposed a modified fuzzy based KNN algorithm MFZ-KNN whereby fuzzy clusters are obtained at preprocessing step and the membership of the training data set is computed in reference with the centroid of the clusters. This reduces the complexity of time remarkably. We have implemented the algorithm in MatLAB and Netbeans IDE using standard UCI data set-Wine. The results prove that it is better than both conventional KNN and fuzzy KNN in terms of accuracy and time.

[1]  Vandana,et al.  Survey of Nearest Neighbor Techniques , 2010, ArXiv.

[2]  Shengrui Wang,et al.  Nearest Neighbor Classification by Partially Fuzzy Clustering , 2012, 2012 26th International Conference on Advanced Information Networking and Applications Workshops.

[3]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[4]  Yaxin Bi,et al.  KNN Model-Based Approach in Classification , 2003, OTM.

[5]  M. Mahajan,et al.  Performance Comparison of Fuzzy C Means with Respect to Other Clustering Algorithm , 2014 .

[6]  Anil K. Jain,et al.  NOTE ON DISTANCE-WEIGHTED k-NEAREST NEIGHBOR RULES. , 1978 .

[7]  J. Bezdek,et al.  Generalized k -nearest neighbor rules , 1986 .

[8]  Dianhong Wang,et al.  Survey of Improving K-Nearest-Neighbor for Classification , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[9]  Adam Józwik,et al.  A learning scheme for a fuzzy k-NN rule , 1983, Pattern Recognit. Lett..

[10]  Teck Wee Chua,et al.  A new fuzzy rule-based initialization method for K-Nearest neighbor classifier , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[11]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[12]  Francisco Herrera,et al.  Fuzzy nearest neighbor algorithms: Taxonomy, experimental analysis and prospects , 2014, Inf. Sci..

[13]  Sarah Eichmann,et al.  Fuzzy Logic Intelligence Control And Information , 2016 .

[14]  Bo Sun,et al.  Study on the Improvement of K-Nearest-Neighbor Algorithm , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[15]  Hamid Parvin,et al.  A Modification on K-Nearest Neighbor Classifier , 2010 .

[16]  Jun-li Lu,et al.  Research and application on KNN method based on cluster before classification , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[17]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.