A Technique to Identify Nearest Neighbors

A nonarithmetic procedure is described for discovering among a set of points in a d-dimensional space, the k neighbors nearest a given point, according to the Minkowski "max metric." It is shown that this procedure may be used to eliminate distance calculations when finding nearest neighbors according to any Minkowski p-metric. When used with a set of uniformly distributed sample points, the expected number of distance calculations n required by this technique is given by E[n] ¿ kCp,d where Cp,d is a constant determined by p and d. In the case of the Euclidean metric used in two dimensions with 1000 uniformly distributed sample points, the effective number of distance calculations required to find the nearest neighbor is approximately five.

[1]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[2]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[3]  C. G. Hilborn,et al.  The Condensed Nearest Neighbor Rule , 1967 .

[4]  Peter E. Hart,et al.  The condensed nearest neighbor rule (Corresp.) , 1968, IEEE Trans. Inf. Theory.

[5]  Edward A. Patrick,et al.  A Generalized k-Nearest Neighbor Rule , 1970, Inf. Control..

[6]  E. Patrick,et al.  Fundamentals of Pattern Recognition , 1973 .

[7]  Chin-Liang Chang,et al.  Finding Prototypes For Nearest Neighbor Classifiers , 1974, IEEE Transactions on Computers.

[8]  Laveen N. Kanal,et al.  Patterns in pattern recognition: 1968-1974 , 1974, IEEE Trans. Inf. Theory.

[9]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Computing k-Nearest Neighbors , 1975, IEEE Transactions on Computers.

[10]  Hugh B. Woodruff,et al.  An algorithm for a selective nearest neighbor decision rule (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[11]  Forest Baskett,et al.  An Algorithm for Finding Nearest Neighbors , 1975, IEEE Transactions on Computers.