Relational histograms for shape indexing

This paper is concerned with the retrieval of images from large databases based on their shape similarity to a query image. Our approach is based on two dimensional histograms that encode both the local and global geometric properties of the shapes. The pairwise attributes are the directed segment relative angle and directed relative position. The novelty of the proposed approach is to simultaneously use the relational and structural constraints, derived from an adjacency graph, to gate histogram contributions. We investigate the retrieval capabilities of the method for various queries. We also investigate the robustness of the method to segmentation errors. We conclude that a relational histogram of pairwise segment attributes presents a very efficient way of indexing into large databases. The optimal configuration is obtained when the local features are constructed from six neighbouring segments pairs. Moreover, a sensitivity analysis reveals that segmentation errors do not affect the retrieval performances.

[1]  Benoit Huet,et al.  Cartographic indexing into a database of remotely sensed images , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[2]  Timothy F. Cootes,et al.  Active Shape Model Search using Pairwise Geometric Histograms , 1996, BMVC.

[3]  Edwin R. Hancock,et al.  Relational matching by discrete relaxation , 1995, Image Vis. Comput..

[4]  Neil A. Thacker,et al.  The Use of Geometric Histograms for Model-Based Object Recognition , 1993, BMVC.

[5]  A.W.M. Smeulders,et al.  Enigma: an image retrieval system , 1992 .

[6]  B. Huet,et al.  Structural Indexing of Infra-red Images using Statistical Histogram Comparison , 1996 .

[7]  Edwin R. Hancock,et al.  Sensitivity analysis for structural matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[9]  Rosalind W. Picard Light-years from Lena: video and image libraries of the future , 1995, Proceedings., International Conference on Image Processing.

[10]  Edwin R. Hancock,et al.  Structural Matching by Discrete Relaxation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  M. S. Costa,et al.  Scene analysis using appearance-based models and relational indexing , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[12]  Edwin R. Hancock,et al.  Resolving edge-line ambiguities using probabilistic relaxation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  K. Boyer,et al.  Organizing Large Structural Modelbases , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Michael J. Swain,et al.  The capacity of color histogram indexing , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[16]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[17]  Anil K. Jain,et al.  View organization and matching of free-form objects , 1995, Proceedings of International Symposium on Computer Vision - ISCV.