A fuzzy K-nearest neighbor algorithm

Classification of objects is an important area of research and application in a variety of fields. In the presence of full knowledge of the underlying probabilities, Bayes decision theory gives optimal error rates. In those cases where this information is not present, many algorithms make use of distance or similarity among samples as a means of classification. The K-nearest neighbor decision rule has often been used in these pattern recognition problems. One of the difficulties that arises when utilizing this technique is that each of the labeled samples is given equal importance in deciding the class memberships of the pattern to be classified, regardless of their `typicalness'. The theory of fuzzy sets is introduced into the K-nearest neighbor technique to develop a fuzzy version of the algorithm. Three methods of assigning fuzzy memberships to the labeled samples are proposed, and experimental results and comparisons to the crisp version are presented.

[1]  G T Toussaint,et al.  An efficient method for estimating the probability of misclassification applied to a problem in medical diagnosis. , 1975, Computers in biology and medicine.

[2]  Thomas M. Cover,et al.  Estimation by the nearest neighbor rule , 1968, IEEE Trans. Inf. Theory.

[3]  A Wardle,et al.  Computer Aided Diagnosis – A Review of Research , 1978, Methods of Information in Medicine.

[4]  A. Bonaert.  Introduction to the theory of Fuzzy subsets , 1977, Proceedings of the IEEE.

[5]  J A Rinaldo,et al.  Symptom diagnosis: optimal subsets for upper abdominal pain. , 1967, Computers and biomedical research, an international journal.

[6]  Larry D. Hostetler,et al.  k-nearest-neighbor Bayes-risk estimation , 1975, IEEE Trans. Inf. Theory.

[7]  C. G. Hilborn,et al.  The Condensed Nearest Neighbor Rule , 1967 .

[8]  Martin E. Hellman,et al.  The Nearest Neighbor Classification Rule with a Reject Option , 1970, IEEE Trans. Syst. Sci. Cybern..

[9]  Adam Józwik,et al.  A learning scheme for a fuzzy k-NN rule , 1983, Pattern Recognit. Lett..

[10]  Ivan Tomek,et al.  A Generalization of the k-NN Rule , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[12]  P. Strevens.  Iii , 1985 .

[13]  Pierre A. Devijver,et al.  New error bounds with the nearest neighbor rule (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[14]  James M. Keller,et al.  Incorporating Fuzzy Membership Functions into the Perceptron Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[16]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[17]  J. Gower,et al.  Methods for statistical data analysis of multivariate observations , 1977, A Wiley publication in applied statistics.

[18]  Paul P. Wang,et al.  Fuzzy sets : theory and applications to policy analysis and information systems , 1981 .

[19]  Kathryn T. Spoehr,et al.  Visual Information Processing , 1982 .

[20]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[21]  Vijay K. Rohatgi,et al.  Advances in Fuzzy Set Theory and Applications , 1980 .

[22]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[23]  Abraham Kandel,et al.  Fuzzy techniques in pattern recognition , 1982 .

[24]  Belur V. Dasarathy,et al.  Nosing Around the Neighborhood: A New System Structure and Classification Rule for Recognition in Partially Exposed Environments , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[26]  P. Dodwell.  Visual Pattern Recognition , 1970 .