Compact combination of MPEG-7 color and texture descriptors for image retrieval

Multimedia databases are meaningfully indexed and retrieved with content based image retrieval (CBIR) systems. MPEG-7 standard describes visual descriptors and performance metrics for CBIR systems. Amongst all image features, color and texture are more visually expressive and hence are attractive for image retrieval descriptors enhances image retrieval and efficiency of a multimedia database. Further, combination of features makes image retrieval more relevant and robust. This paper proposes efficient methods for compactly representing color and texture features and combining them for image retrieval. The proposed methods use MPEG-7 visual descriptors namely, scalable color descriptor (SCD) for color and, homogeneous texture descriptor (HTD) for texture representation respectively. This paper investigates how compactly a descriptor could be defined and yet be used as a metric for image retrieval. If the descriptor is compact and yet performs meaningful image retrieval, then it is computationally efficient. Image classification, clustering and hierarchical modeling of image databases will benefit with such a representation. The performance of retrieval based on compact descriptors obtained by proposed techniques is analyzed with MPEG-7 metrics.

[1]  Thomas Sikora,et al.  The MPEG-7 visual standard for content description-an overview , 2001, IEEE Trans. Circuits Syst. Video Technol..

[2]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  D. Sagi,et al.  Gabor filters as texture discriminator , 1989, Biological Cybernetics.

[4]  B. S. Manjunath,et al.  MPEG‐7 Homogeneous Texture Descriptor , 2001 .

[5]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[6]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[7]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[8]  B. S. Manjunath,et al.  Tools for texture- and color-based search of images , 1997, Electronic Imaging.

[9]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Proceedings of International Conference on Image Processing.

[10]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Christine Fernandez-Maloigne,et al.  IRIS – Color Texture Indexing and Recognition Toolbox , 2002 .

[12]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[13]  Jianying Hu,et al.  Matching and retrieval based on the vocabulary and grammar of color patterns , 2000, IEEE Trans. Image Process..

[14]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[15]  Bangalore S. Manjunath,et al.  Tools for texture/color based search of images , 1997 .

[16]  Jake K. Aggarwal,et al.  CIRES: a system for content-based retrieval in digital image libraries , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..