Aggregate Metric Networks for Nearest Neighbour Classifiers

A common idea prevailing in distance or similarity measures is the use of aggregate operators in localised and point-wise differences or similarity calculation between two patterns. We test the impact of aggregate operations such as min, max, average, sum, product, sum of products and median on distance measures and similarity measures for nearest neighbour classification. The point-wise differences or similarities extends the idea of distance measurements from the decision space to feature space for the extraction of inter-feature dependencies in high dimensional patterns such as images. Inter-feature spatial differences are extracted using the gradient functions across various directions and then applied on aggregate function, to result in a fused feature set. The initial study is conducted on Iris flower and verified using AR face database. The resulting method shows an accuracy of 92% on face recognition task using the standard AR database.

[1]  C. Tappert,et al.  A Survey of Binary Similarity and Distance Measures , 2010 .

[2]  Simone Santini,et al.  Similarity Measures , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[4]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[5]  Robert W. G. Hunt,et al.  The reproduction of colour , 1957 .

[6]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[7]  Paul M. B. Vitányi,et al.  The Google Similarity Distance , 2004, IEEE Transactions on Knowledge and Data Engineering.

[8]  A. Martínez,et al.  The AR face databasae , 1998 .

[9]  E. Anderson The Species Problem in Iris , 1936 .

[10]  Mirella Lapata,et al.  An Experimental Study of Graph Connectivity for Unsupervised Word Sense Disambiguation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Azriel Rosenfeld,et al.  Digital Picture Processing , 1976 .

[12]  Philip Resnik,et al.  Using Information Content to Evaluate Semantic Similarity in a Taxonomy , 1995, IJCAI.

[13]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[14]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[15]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .