Component-based visual clustering using the self-organizing map

In this paper we present a new method for visual clustering of multi-component images such as trademarks, using the topological properties of the self-organizing map, and show how it can be used for similarity retrieval from a database. The method involves two stages: firstly, the construction of a 2D map based on features extracted from image components, and secondly the derivation of a Component Similarity Vector from a query image, which is used in turn to derive a 2D map of retrieved images. The retrieval effectiveness of this novel component-based shape matching approach has been evaluated on a set of over 10 000 trademark images, using a spatially-based precision-recall measure. Our results suggest that our component-based matching technique performs markedly better than matching using whole-image clustering, and is relatively insensitive to changes in input parameters such as network size.

[1]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[2]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[4]  Erkki Oja,et al.  S-Map: A Network with a Simple Self-Organization Algorithm for Generative Topographic Mappings , 1997, NIPS.

[5]  José Alfredo Ferreira Costa,et al.  Hierarchical SOM applied to image compression , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[6]  Santiago Torres-Alegre,et al.  Using self-organizing maps to identify potential halo white dwarfs , 2003, Neural Networks.

[7]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[8]  John P. Eakins,et al.  Visual Clustering of Trademarks Using a Component-Based Matching Framework , 2004, CIVR.

[9]  Erkki Oja,et al.  The PicSOM Retrieval System: Description and Evaluations , 2000 .

[10]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[11]  Michael S. Lew,et al.  Principles of Visual Information Retrieval , 2001, Advances in Pattern Recognition.

[12]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[13]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  R. Manmatha,et al.  Multi-modal Retrieval of Trademark Images Using Global Similarity TITLE2: , 1999 .

[15]  Rosalind W. Picard.  A Society of Models for Video and Image Libraries , 1996, IBM Syst. J..

[16]  Erkki Oja,et al.  Kohonen Maps , 1999, Encyclopedia of Machine Learning.

[17]  Graham Sexton,et al.  Visual Clustering of Trademarks Using the Self-Organizing Map , 2002, CIVR.

[18]  John P. Eakins,et al.  Shape Feature Matching for Trademark Image Retrieval , 2003, CIVR.

[19]  Shu-Yuan Chen,et al.  Trademark shape recognition using closed contours , 1997, Pattern Recognit. Lett..

[20]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[21]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[22]  Whoi-Yul Kim,et al.  Content-based trademark retrieval system using a visually salient feature , 1998, Image Vis. Comput..

[23]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[24]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Simone Santini,et al.  The "El Nino" image database system , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[26]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[27]  Kerry Rodden,et al.  A comparison of measures for visualising image similarity , 2000 .

[28]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[29]  M. E. Maron,et al.  An evaluation of retrieval effectiveness for a full-text document-retrieval system , 1985, CACM.

[30]  Rajiv Mehrotra,et al.  Similar-Shape Retrieval in Shape Data Management , 1995, Computer.

[31]  Christos Faloutsos,et al.  Efficient and effective Querying by Image Content , 1994, Journal of Intelligent Information Systems.

[32]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[33]  Erkki Oja,et al.  Self-Organizing Maps for Content-Based Image Database Retrieval , 1999 .

[34]  John P. Eakins,et al.  Similarity Retrieval of Trademark Images , 1998, IEEE Multim..

[35]  Andreas Rauber,et al.  The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data , 2002, IEEE Trans. Neural Networks.

[36]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[37]  Toshikazu Kato,et al.  Database architecture for content-based image retrieval , 1992, Electronic Imaging.

[38]  Giovanni Soda,et al.  Logo Recognition by Recursive Neural Networks , 1997, GREC.

[39]  Paul L. Rosin,et al.  Comparison of the effectiveness of alternative feature sets in shape retrieval of multicomponent images , 2001, IS&T/SPIE Electronic Imaging.

[40]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[41]  Greet Frederix,et al.  Content-based image retrieval as a tool for image understanding , 1999, Optics East.

[42]  Thomas Sikora,et al.  The MPEG-7 visual standard for content description-an overview , 2001, IEEE Trans. Circuits Syst. Video Technol..

[43]  John P. Eakins.  Trademark Image Retrieval , 2001, Principles of Visual Information Retrieval.

[44]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[45]  Paul L. Rosin.  Measuring shape: ellipticity, rectangularity, and triangularity , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[46]  Babu M. Mehtre,et al.  Content-based retrieval for trademark registration , 1996, Multimedia Tools and Applications.