A generalization of dissimilarity representations using feature lines and feature planes

Even though, under representational restrictions, the nearest feature rules and the dissimilarity-based classifiers are feasible alternatives to the nearest neighbor method; individually, they may not be sufficiently powerful if a very small set of prototypes is required, e.g. when it is computationally expensive to deal with larger sets of prototypes. In this paper, we show that combining both strategies, taking advantage of their individual properties, provides an improvement, particularly for correlated data sets. The combined strategy consists in deriving an enriched (generalized) dissimilarity representation by using the nearest feature rules, namely feature lines and feature planes. On top of that enriched representation, Bayesian classifiers can be constructed in order to obtain a good generalization.

[1]  Wenming Zheng,et al.  Locally nearest neighbor classifiers for pattern classification , 2004, Pattern Recognit..

[2]  T. A. Brown,et al.  Theory of Equations. , 1950, The Mathematical Gazette.

[3]  Jen-Tzung Chien,et al.  Discriminant Waveletfaces and Nearest Feature Classifiers for Face Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Stan Z. Li,et al.  Performance Evaluation of the Nearest Feature Line Method in Image Classification and Retrieval , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yan Qiu Chen,et al.  Rectified nearest feature line segment for pattern classification , 2007, Pattern Recognit..

[6]  Stan Z. Li,et al.  Content-based Classification and Retrieval of Audio Using the Nearest Feature Line Method , 2000 .

[7]  Robert P. W. Duin,et al.  A Generalized Kernel Approach to Dissimilarity-based Classification , 2002, J. Mach. Learn. Res..

[8]  Filiberto Pla,et al.  Experimental study on prototype optimisation algorithms for prototype-based classification in vector spaces , 2006, Pattern Recognit..

[9]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[10]  Robert P. W. Duin,et al.  Dissimilarity-based classification for vectorial representations , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Germán Castellanos-Domínguez,et al.  Comparison of the nearest feature classifiers for face recognition , 2006, Machine Vision and Applications.

[12]  Robert P. W. Duin,et al.  Dissimilarity representations allow for building good classifiers , 2002, Pattern Recognit. Lett..

[13]  J. Roodenburg,et al.  Autofluorescence characteristics of healthy oral mucosa at different anatomical sites , 2003, Lasers in surgery and medicine.

[14]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[15]  W. Highleyman.  Linear Decision Functions, with Application to Pattern Recognition , 1962, Proceedings of the IRE.

[16]  Ke Chen,et al.  On the use of nearest feature line for speaker identification , 2002, Pattern Recognit. Lett..

[17]  Robert P. W. Duin,et al.  Prototype selection for dissimilarity-based classifiers , 2006, Pattern Recognit..

[18]  Robert P. W. Duin,et al.  Possibilities of Zero-Error Recognition by Dissimilarity Representations , 2002, PRIS.

[19]  J. Friedman.  Regularized Discriminant Analysis , 1989 .

[20]  Bülent Sankur,et al.  ARTICLE IN PRESS Image and Vision Computing xx (2005) 1–9 www.elsevier.com/locate/imavis , 2004 .

[21]  Robert P. W. Duin,et al.  The Dissimilarity Representation for Pattern Recognition - Foundations and Applications , 2005, Series in Machine Perception and Artificial Intelligence.

[22]  J. Kittler,et al.  Summary of Panel Discussion on Decision Theoretic Methods , 1982 .

[23]  Stan Z. Li,et al.  Content-based audio classification and retrieval using the nearest feature line method , 2000, IEEE Trans. Speech Audio Process..