Pattern Recognition as a Human Centered non-Euclidean Problem

Regularities in the world are human defined. Patterns in the observed phenomena are there because we define and recognize them as such. Automatic pattern recognition tries to bridge the gap between human judgment and measurements made by artificial sensors. This is done in two steps: representation and generalization. Traditional representations of real world objects to be recognized, like features and pixels, either neglect possibly significant aspects of the objects, or neglect their dependencies. We therefor reconsider human recognition and observe that it is based on our direct experience of similarity or dissimilarity of objects. Using these concepts, a pattern recognition system can be defined in a natural way by a pairwise comparison of objects. This results in the dissimilarity representation for pattern recognition. An analysis of dissimilarity measures optimized for performance shows that they tend to be non-Euclidean. The Euclidean vector spaces, traditionally used in pattern recognition and machine learning may thereby be suboptimal. The causes and consequences of the use of non-Euclidean representations will be discussed. It is conjectured that human judgment of object differences result in these non-Euclidean representations as object structure is taken into account.

[1]  Anil K. Jain,et al.  Representation and Recognition of Handwritten Digits Using Deformable Templates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Virendrakumar C. Bhavsar,et al.  Can a vector space based learning model discover inductive class generalization in a symbolic environment? , 1995, Pattern Recognit. Lett..

[3]  R. Duin,et al.  The dissimilarity representation for pattern recognition , a tutorial , 2009 .

[4]  Elzbieta Pekalska,et al.  Kernel Discriminant Analysis for Positive Definite and Indefinite Kernels , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Robert P. W. Duin,et al.  The Dissimilarity Representation for Pattern Recognition - Foundations and Applications , 2005, Series in Machine Perception and Artificial Intelligence.

[6]  Robert P. W. Duin,et al.  Beyond Traditional Kernels: Classification in Two Dissimilarity-Based Representation Spaces , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Robert P. W. Duin,et al.  Non-Euclidean Dissimilarities: Causes and Informativeness , 2010, SSPR/SPR.

[8]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.