Building Visual Vocabulary for Image Indexation and Query Formulation

Abstract:With advances in digital imaging, the amount of digital images will increase tremendously. To locate relevant images in a large collection of images presents a challenging and genuine problem for content-based retrieval research. This paper presents a novel framework called visual keywords for image indexation and query formulation. Visual keywords are flexible and intuitive visual prototypes specified perceptually from sample domain images. A visual content is described and indexed by flexible spatial aggregation of the soft presence of visual keywords. A new query method based on visual constraints is also proposed to allow direct and explicit content specification. Last but not least, we have developed a digital album prototype to demonstrate query and retrieval on both home photos and stock photos based on visual keywords.

[1]  Stephen E. Robertson,et al.  Relevance weighting of search terms , 1976, J. Am. Soc. Inf. Sci..

[2]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[3]  Joo-Hwee Lim,et al.  Categorizing Visual Contents by Matching Visual "Keywords" , 1999, VISUAL.

[4]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rosalind W. Picard.  Toward a Visual Thesaurus , 1995, MIRO.

[6]  Neill W. Campbell,et al.  Employing Region Features for Searching an Image Database , 1997, BMVC.

[7]  Jing Huang,et al.  An automatic hierarchical image classification scheme , 1998, MULTIMEDIA '98.

[8]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[9]  W. Eric L. Grimson,et al.  Configuration based scene classification and image indexing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Joo-Hwee Lim.  Learnable visual keywords for image classification , 1999, DL '99.

[11]  Ramin Zabih,et al.  Comparing images using joint histograms , 1999, Multimedia Systems.

[12]  Joo-Hwee Lim,et al.  Visual Keywords: from Text Retrieval to Multimedia Retrieval , 2000 .

[13]  Joo-Hwee Lim.  Incremental Case-based Pattern Classifier , 1993 .

[14]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[15]  Joo-Hwee Lim.  Learning visual keywords for content-based retrieval , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[16]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[17]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[18]  Joo Hwee Lim,et al.  Fuzzy constraint logic programming: a proposal , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[19]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[20]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[21]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Ingemar J. Cox,et al.  PicHunter: Bayesian relevance feedback for image retrieval , 1996, Proceedings of 13th International Conference on Pattern Recognition.