Efficient shape retrieval by parts

Modern visual information retrieval systems support retrieval by directly addressing image visual features such as color, texture, shape and spatial relationships. However, combining useful representations and similarity models with effcient index structures is a problem that has been largely underestimated. This problem is particularly challenging in the case of retrieval by shape similarity. In this paper we discuss retrieval by shape similarity, using local features and metric indexing. Shape is partitioned into tokens in correspondence with its protrusions, and each token is modeled by a set of perceptually salient attributes. Two distinct distance functions are used to model token similarity and shape similarity. Shape indexing is obtained by arranging tokens into a M-tree index structure. Examples from a prototype system are expounded with considerations about the effectiveness of the approach.

[1]  Robert M. Haralick,et al.  Structural Descriptions and Inexact Matching , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Hanan Samet,et al.  Hierarchical representations of collections of small rectangles , 1988, CSUR.

[3]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[4]  Alberto Del Bimbo,et al.  Visual Image Retrieval by Elastic Matching of User Sketches , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Pavel Zezula,et al.  M-tree: An Efficient Access Method for Similarity Search in Metric Spaces , 1997, VLDB.

[6]  Rosalind W. Picard A Society of Models for Video and Image Libraries , 1996, IBM Syst. J..

[7]  Rajiv Mehrotra,et al.  Similar-Shape Retrieval in Shape Data Management , 1995, Computer.

[8]  Stan Sclaroff,et al.  Deformable prototypes for encoding shape categories in image databases , 1995, Pattern Recognit..

[9]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  William I. Grosky,et al.  Index-based object recognition in pictorial data management , 1990, Comput. Vis. Graph. Image Process..

[11]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Alberto Del Bimbo,et al.  Visual Querying By Color Perceptive Regions , 1998, Pattern Recognit..

[13]  MAX J. EGENHOFER,et al.  Point Set Topological Relations , 1991, Int. J. Geogr. Inf. Sci..