WAY-LOOK4: A CBIR system based on class signature of the images' color and texture features

This paper presents WhatAreYouLOOKing4 (WAY-LOOK4) system, a novel framework for content-based image retrieval (CBIR). Local descriptors are used to describe the visual contents of an image. Image signatures and similarity retrieval are based on the images' color and texture features. The main motivation of the system design is to use simple and efficient techniques to maintain reasonable computational and storage cost. The proposed technique has three system components: feature extraction, image database indexing and similarity retrieval. First, the use of circular sectors is proposed to represent local first order moment for the color feature. In addition, a local direction technique is used for texture feature extraction. Secondly, the hash indexing of the images' color properties is used to map the database images into classes. Hash indexing speeds up the search and enhances the system scalability for large image databases. Thirdly, for similarity retrieval, a degree of similarity is defined based on a weighted sum of the color and texture features. In addition, the similarity retrieval incorporates a minimum accepted degree of similarity provided by the user. The test of similarity is performed in two stages. In the first stage, the index is used to directly hit a class to which the query image may belong. In the second stage, a detailed sequential search is performed to retrieve the most similar images within that class. The simple design of the system and experimental selection of system parameters guarantee that the system maintains reasonable storage and computational cost. Our experiments demonstrate that the average precision of retrieved images is enhanced especially for higher accepted degrees of similarity.

[1]  J. Moore,et al.  Boolean Function Matching using Walsh Spectral Decision Diagrams , 2006, 2006 IEEE Dallas/CAS Workshop on Design, Applications, Integration and Software.

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[4]  J. Holliday Sun , 1995 .

[5]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Remco C. Veltkamp,et al.  Content-based image retrieval systems: A survey , 2000 .

[7]  H. Wilhelm,et al.  Clinical Neuro-Ophthalmology , 2007 .

[8]  Myron Flickner,et al.  Query by Image and Video Content , 1995 .

[9]  Remco C. Veltkamp,et al.  A Survey of Content-Based Image Retrieval Systems , 2002 .

[10]  Fuhui Long,et al.  Fundamentals of Content-Based Image Retrieval , 2003 .

[11]  J. Keltner Walsh & Hoyt's Clinical Neuro-Ophthalmology, Volume 4 , 1992 .

[12]  Wang Xiaoling,et al.  Application of the fuzzy logic in content-based image retrieval , 2005 .

[13]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[14]  Yixin Chen,et al.  CLUE: cluster-based retrieval of images by unsupervised learning , 2005, IEEE Transactions on Image Processing.

[15]  Tao Wang,et al.  Constraint Based Region Matching for Image Retrieval , 2004, International Journal of Computer Vision.

[16]  R. Thorpe,et al.  CLINICAL NEURO-OPHTHALMOLOGY , 1958, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[17]  N. Newman,et al.  Walsh and Hoyt's Clinical Neuro Ophthalmology , 1982 .

[18]  Rohini K. Srihari,et al.  Spatial color histograms for content-based image retrieval , 1999, Proceedings 11th International Conference on Tools with Artificial Intelligence.

[19]  Hideyuki Tamura,et al.  Image database systems: A survey , 1984, Pattern Recognit..

[20]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[21]  Arun Ross,et al.  A hybrid fingerprint matcher , 2002, Object recognition supported by user interaction for service robots.

[22]  Yixin Chen,et al.  A Region-Based Fuzzy Feature Matching Approach to Content-Based Image Retrieval , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Yixin Chen,et al.  Looking beyond region boundaries: a robust image similarity measure using fuzzified region features , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..