An Attribute Contribution-Based K-Nearest Neighbor Classifier

K-nearest neighbor algorithm (KNN) is one of the most representative methods in data mining classification techniques. However, the KNN algorithm has a problem that when the traditional Euclidean distance formula is used to calculate the nearest neighbor distance, we ignore the relationship between attributes in the feature space. To tackle this issue, a covariance matrix is used to calculate the attribute contribution of the samples in order to solve the above problem. So an attribute contribution-based k-nearest neighbor classifier (ACWKNN) is proposed in this paper. The proposed algorithm is compared and experimented on the UCI standard dataset, and the results show that the method outperforms other KNN algorithms.

[1]  Xiaofeng Zhu,et al.  Efficient kNN Classification With Different Numbers of Nearest Neighbors , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  O S Sitompul,et al.  Improving the accuracy of k-nearest neighbor using local mean based and distance weight , 2018 .

[3]  Hareton K. N. Leung,et al.  Hybrid $k$ -Nearest Neighbor Classifier , 2016, IEEE Transactions on Cybernetics.

[4]  Yongzhao Zhan,et al.  Improved pseudo nearest neighbor classification , 2014, Knowl. Based Syst..

[5]  Hong Liu,et al.  Coarse to fine K nearest neighbor classifier , 2013, Pattern Recognit. Lett..

[6]  Randall Davis.  Knowledge-Based Systems , 1986, Science.

[7]  Xu Fu,et al.  Density Peaks Clustering Algorithm Based on K Nearest Neighbors , 2022, Advances in Intelligent Systems and Computing.

[8]  Jiazhen Hou,et al.  Density peaks clustering algorithm based on kernel density estimation and minimum spanning tree , 2022, International Journal of Innovative Computing and Applications.

[9]  Alamsyah,et al.  Accuracy enhancement in face recognition using 1D-PCA & 2D-PCA based on multilevel reverse-biorthogonal wavelet transform with KNN classifier , 2021 .

[10]  Piyush Kumar,et al.  Performance Analysis of Nearest Neighbor, K-Nearest Neighbor and Weighted K-Nearest Neighbor for the Classification of Alzheimer Disease , 2020 .

[11]  Yidi Wang,et al.  A new k-harmonic nearest neighbor classifier based on the multi-local means , 2017, Expert Syst. Appl..

[12]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.