Dissimilarity-based classification for vectorial representations

General dissimilarity-based learning approaches have been proposed for dissimilarity data sets (Pekalska et al., 2002). They arise in problems in which direct comparisons of objects are made, e.g. by computing pairwise distances between images, spectra, graphs or strings. In this paper, we study under which circumstances such dissimilarity-based techniques can be used for deriving classifiers in feature vector spaces. We show that such classifiers perform comparably or better than the nearest neighbor rule based either on the entire or condensed training set. Moreover, they can be beneficial for highly-overlapping classes and for non-normally distributed data sets, with categorical, mixed or otherwise difficult features

[1]  Robert P. W. Duin,et al.  A Generalized Kernel Approach to Dissimilarity-based Classification , 2002, J. Mach. Learn. Res..

[2]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[3]  Filiberto Pla,et al.  Experimental study on prototype optimisation algorithms for prototype-based classification in vector spaces , 2006, Pattern Recognit..

[4]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[5]  Chin-Liang Chang,et al.  Finding Prototypes For Nearest Neighbor Classifiers , 1974, IEEE Transactions on Computers.

[6]  F. Pla,et al.  Improving the k-NCN classification rule through heuristic modifications , 1998, Pattern Recognit. Lett..

[7]  Belur V. Dasarathy,et al.  Nearest neighbor (NN) norms: NN pattern classification techniques , 1991 .

[8]  Robert P. W. Duin,et al.  Prototype selection for dissimilarity-based classifiers , 2006, Pattern Recognit..

[9]  C. G. Hilborn,et al.  The Condensed Nearest Neighbor Rule , 1967 .

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  Tony R. Martinez,et al.  Reduction Techniques for Instance-Based Learning Algorithms , 2000, Machine Learning.

[12]  R. C. Williamson,et al.  Classification on proximity data with LP-machines , 1999 .

[13]  Robert P. W. Duin,et al.  The Dissimilarity Representation for Pattern Recognition - Foundations and Applications , 2005, Series in Machine Perception and Artificial Intelligence.

[14]  J. Davenport Editor , 1960 .

[15]  Cor J. Veenman,et al.  Turning the hyperparameter of an AUC-optimized classifier , 2005, BNAIC.

[16]  Peter E. Hart,et al.  The condensed nearest neighbor rule (Corresp.) , 1968, IEEE Trans. Inf. Theory.