The Semantic Clustering of Images and Its Relation with Low Level Color Features

Content-based image retrieval - CBIR uses visual content (low-level features) of images such as color, texture, shape, etc. to representand to index images. Extensive experiments on CBIR show that low-level features not represent exactly the high-level semantic concepts and can fail when used to retrieve similar images. In order to overpass this problem, different approaches aim to propose new methods that use different techniques combined with low-level descriptors. In this work, we analyze the relation between low-level color features and the high-level features to justify or not the use of these descriptors in the CBIR process. In this sense, a group of users were asked about the similarity of a group of images. After, Semantic clusters were established based on their answers. These clusters are compared with the classification obtained by color descriptors of the MPEG-7 standard, giving us an idea about the situations in which these low level color features can be used for CBIR and properties of their application.

[1]  Marco La Cascia,et al.  Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web , 1999, Comput. Vis. Image Underst..

[2]  Ben Bradshaw,et al.  Semantic based image retrieval: a probabilistic approach , 2000, ACM Multimedia.

[3]  John R. Smith,et al.  MPEG-7 multimedia description schemes , 2001, IEEE Trans. Circuits Syst. Video Technol..

[4]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[5]  Erkki Oja,et al.  PicSOM - content-based image retrieval with self-organizing maps , 2000, Pattern Recognit. Lett..

[6]  B. S. Manjunath,et al.  Cortina: a system for large-scale, content-based web image retrieval , 2004, MULTIMEDIA '04.

[7]  Noel E. O'Connor,et al.  Relating Visual and Semantic Image Descriptors , 2004, EWIMT.

[8]  Thrasyvoulos N. Pappas,et al.  Perceptually based techniques for image segmentation and semantic classification , 2007, IEEE Communications Magazine.

[9]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[10]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[11]  Yi-Leh Wu,et al.  Cluster and Clustering Algorithm Validity in Image Retrieval , 2006, SMC.

[12]  Yixin Chen,et al.  An unsupervised learning approach to content-based image retrieval , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[13]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Matthieu Cord,et al.  RETIN: A Content-Based Image Indexing and Retrieval System , 2001, Pattern Analysis & Applications.

[15]  Rohini K. Srihari,et al.  Spatial color histograms for content-based image retrieval , 1999, Proceedings 11th International Conference on Tools with Artificial Intelligence.

[16]  Theo Gevers,et al.  Color-Based Retrieval , 2001, Principles of Visual Information Retrieval.

[17]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[18]  Jing Huang,et al.  Spatial Color Indexing and Applications , 2004, International Journal of Computer Vision.

[19]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Tong Wang,et al.  A Novel Method of Image Retrieval Based on Combination of Semantic and Visual Features , 2005, FSKD.

[21]  Shi-Kuo Chang,et al.  Picture Indexing and Abstraction Techniques for Pictorial Databases , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  James Ze Wang,et al.  Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Yung-Kuan Chan,et al.  Image retrieval system based on color-complexity and color-spatial features , 2004, J. Syst. Softw..

[24]  Yixin Chen,et al.  CLUE: cluster-based retrieval of images by unsupervised learning , 2005, IEEE Transactions on Image Processing.

[25]  高文,et al.  Exploiting multi-context analysis in semantic image classification , 2005 .

[26]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[27]  Yixin Chen,et al.  Content-based image retrieval by clustering , 2003, MIR '03.

[28]  Esa Alhoniemi,et al.  Clustering of the self-organizing map , 2000, IEEE Trans. Neural Networks Learn. Syst..

[29]  Aidong Zhang,et al.  SemQuery: Semantic Clustering and Querying on Heterogeneous Features for Visual Data , 2002, IEEE Trans. Knowl. Data Eng..

[30]  Antonio Robles-Kelly,et al.  Image feature evaluation for contents-based image retrieval , 2006 .

[31]  Mingjing Li,et al.  Web mining for Web image retrieval , 2001, J. Assoc. Inf. Sci. Technol..