Spatial arrangement of color in retrieval by visual similarity

In image search based on chromatic similarity, the effectiveness of retrieval can be improved by taking into account the spatial arrangement of colors. This can serve both to distinguish images with the same colors in different arrangement, and to capture the similarity between images with different colors but similar arrangements. We propose a model of representation and comparison which attains this goal by partitioning the image in separate entities and by associating them with individual chromatic attributes and with mutual spatial relationships. The effectiveness of the proposed model is assessed in a user-based evaluation. Experimental results show the capability of the model to join and balance chromatic and spatial similarity, thus improving the effectiveness of retrieval with respect to representations based on a global histogram.

[1]  E. Vicario,et al.  Using weighted spatial relationships in retrieval by visual contents , 1998 .

[2]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[3]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[4]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[5]  Julian R. Ullmann,et al.  An Algorithm for Subgraph Isomorphism , 1976, J. ACM.

[6]  Shih-Fu Chang,et al.  Integrated spatial and feature image query , 1999, Multimedia Systems.

[7]  Joshua R. Smith,et al.  Image retrieval evaluation , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[8]  Alberto Del Bimbo,et al.  The computational aspect of retrieval by spatial arrangement , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[9]  Alberto Del Bimbo,et al.  Visual Querying By Color Perceptive Regions , 1998, Pattern Recognit..

[10]  Alberto Del Bimbo,et al.  A look-ahead strategy for graph matching in retrieval by spatial arrangement , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[11]  Michael A. Arbib,et al.  Color Image Segmentation using Competitive Learning , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[13]  Alberto Del Bimbo,et al.  Efficient Matching and Indexing of Graph Models in Content-Based Retrieval , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[15]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[16]  Alberto Del Bimbo,et al.  Weighted walkthroughs between extended entities for retrieval by spatial arrangement , 2003, IEEE Trans. Multim..

[17]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[18]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[19]  King-Sun Fu,et al.  A graph distance measure for image analysis , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  Stefano Spaccapietra,et al.  Visual Database Systems 3 , 1995, IFIP — The International Federation for Information Processing.