Extracting Bimodal Representations for Language-Based Image Retrieval

This paper explores two approaches to multimedia indexing that might contribute to the advancement of text-based conceptual search for pictorial information. Insights from relatively mature retrieval areas (spoken document retrieval and cross-language retrieval) are taken as a starting point for an investigation of the usefulness of the concept of bimodal dictionaries and of clustering features from multi-modal documents into one semantic space. One of the advantages of the presented techniques is that they are domain independent.

[1]  Michael A. Malcolm,et al.  Computer methods for mathematical computations , 1977 .

[2]  Douglas W. Oard,et al.  A survey of multilingual text retrieval , 1996 .

[3]  Martin Braschler,et al.  Multilingual Information Retrieval Based on Document Alignment Techniques , 1998, ECDL.

[4]  Franciska de Jong.  Twenty-One: a baseline for multilingual multimedia retrieval , 1998 .

[5]  Djoerd Hiemstra.  Multilingual domain modeling in Twenty-One: automatic creation of a bi-directional translation lexicon from a parallel corpus , 1997 .

[6]  Djoerd Hiemstra,et al.  Twenty-One at TREC7: Ad-hoc and Cross-Language Track , 1998, TREC.

[7]  F. Grund.  Forsythe, G. E. / Malcolm, M. A. / Moler, C. B., Computer Methods for Mathematical Computations. Englewood Cliffs, New Jersey 07632. Prentice Hall, Inc., 1977. XI, 259 S , 1979 .

[8]  de Franciska Jong,et al.  OLIVE: Speech-Based Video Retrieval , 1998 .

[9]  A.W.M. Smeulders,et al.  PicToSeek: A Content-based Image Search Engine for the WWW , 1997 .

[10]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[11]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[12]  M. L. Kersten,et al.  Computer vision and image search engines , 1998 .

[13]  Luigi Cinque,et al.  Indexing pictorial documents by their content: a survey of current techniques , 1997, Image Vis. Comput..

[14]  S. Sclaroff,et al.  Combining textual and visual cues for content-based image retrieval on the World Wide Web , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[15]  Wessel Kraaij,et al.  Phoneme based spoken document retrieval , 1998 .

[16]  Yiming Yang,et al.  Translingual Information Retrieval: Learning from Bilingual Corpora , 1998, Artif. Intell..