PBIR-MM: multimodal image retrieval and annotation

We demonstrate PBIR-MM, an integrated system that we have built for conducting multimodal image retrieval. The system combines the strengths of content-based soft annotation (CBSA), multimodal relevance feedback through active learning, and perceptual distance formulation and indexing. PBIR-MM supports multimodal query and annotation in any combination of its three basic modes: seed-by-nothing, seed-by-keywords, and seed-by-content. We demonstrate PBIR-MM on a couple of very large image sets provided by image vendors and crawled from the Internet.

[1]  Edward Y. Chang,et al.  PBIR: perception-based image retrieval-a system that can quickly capture subjective image query concepts , 2001, MULTIMEDIA '01.

[2]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[3]  Edward Y. Chang,et al.  Mining image features for efficient query processing , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[4]  Edward Y. Chang,et al.  CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Mary Czerwinski,et al.  Semi-Automatic Image Annotation , 2001, INTERACT.

[6]  D. Gentner,et al.  Respects for similarity , 1993 .

[7]  Edward Y. Chang,et al.  Effective image annotation via active learning , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[8]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Edward Y. Chang,et al.  DynDex: a dynamic and non-metric space indexer , 2002, MULTIMEDIA '02.

[10]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[11]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[12]  Edward Y. Chang,et al.  Discovery of a perceptual distance function for measuring image similarity , 2003, Multimedia Systems.

[13]  Edward Y. Chang,et al.  PBIR - perception-based image retrieval , 2001, SIGMOD '01.

[14]  Jean-Michel Jolion,et al.  Feature Similarity , 2001, Principles of Visual Information Retrieval.