Efficient Implementation of $k$-Nearest Neighbor Classifier Using Vote Count Circuit

The k-nearest neighbor (k-NN) classification is a nonparametric method to classify objects based on the training set. It is an instance-based classifier operating on the assumption that the unknown instance is related to the known ones according to some distance/similarity functions. In this brief, a hardwareassisted algorithm, i.e., vote count, is introduced to approximate the k-NN classifier to provide a low-cost classification solution. It is found that this hardware-assisted solution achieves similar performance as that of the k-NN classifier. In addition, it is highly scalable with respect to the training sample size, which is essential for the k-NN algorithm to deliver its full potential for real-life classification problems.

[1]  Kiichi Urahama,et al.  Gradient descent learning of nearest neighbor classifiers with outlier rejection , 1995, Pattern Recognit..

[2]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[3]  Wenyu Jiang,et al.  An Algorithm and Hardware Design for Very Fast Similarity Search in High Dimensional Space , 2010, 2010 IEEE International Conference on Granular Computing.

[4]  Yu Rongshan,et al.  High-performance, very low power content-based search engine , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[5]  Keinosuke Fukunaga,et al.  Bias of Nearest Neighbor Error Estimates , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[7]  Ton Kalker,et al.  A Highly Robust Audio Fingerprinting System , 2002, ISMIR.

[8]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[9]  Kiichi Urahama,et al.  Analog circuit implementation and learning algorithm for nearest neighbor classifiers , 1994, Pattern Recognit. Lett..

[10]  Jiun-In Guo,et al.  A new k-winners-take-all neural network and its array architecture , 1998, IEEE Trans. Neural Networks.

[11]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Small Sample Performance , 1952 .

[12]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .