Metric Learning in Dissimilarity Space for Improved Nearest Neighbor Performance

Showing the nearest neighbor is a useful explanation for the result of an automatic classification. Given, expert defined, distance measures may be improved on the basis of a training set. We study several proposals to optimize such measures for nearest neighbor classification, explicitly including non-Euclidean measures. Some of them may directly improve the distance measure, others may construct a dissimilarity space for which the Euclidean distances show significantly better performances. Results are application dependent and raise the question what characteristics of the original distance measures influence the possibilities of metric learning.

[1]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[2]  Robert P. W. Duin,et al.  On the Informativeness of Asymmetric Dissimilarities , 2013, SIMBAD.

[3]  Leon N. Cooper,et al.  Improving nearest neighbor rule with a simple adaptive distance measure , 2007, Pattern Recognit. Lett..

[4]  Mads Nielsen,et al.  Metric learning by directly minimizing the k-NN training error , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Luis Alvarez,et al.  Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications , 2012, Lecture Notes in Computer Science.

[6]  Andrea Torsello,et al.  Similarity-Based Pattern Recognition , 2006, Lecture Notes in Computer Science.

[7]  Robert P. W. Duin,et al.  The Dissimilarity Representation for Pattern Recognition - Foundations and Applications , 2005, Series in Machine Perception and Artificial Intelligence.

[8]  R. Sakia.  The Box-Cox transformation technique: a review , 1992 .

[9]  Robert P. W. Duin,et al.  Dissimilarity-Based Classifications in Eigenspaces , 2011, CIARP.

[10]  Manuele Bicego,et al.  Nonlinear Mappings for Generative Kernels on Latent Variable Models , 2010, 2010 20th International Conference on Pattern Recognition.

[11]  Robert P. W. Duin,et al.  Non-Euclidean Dissimilarities: Causes, Embedding and Informativeness , 2013, Similarity-Based Pattern Analysis and Recognition.

[12]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[13]  Marcello Pelillo,et al.  Similarity-Based Pattern Analysis and Recognition , 2013, Advances in Computer Vision and Pattern Recognition.

[14]  R. Duin,et al.  The dissimilarity representation for pattern recognition , a tutorial , 2009 .