A Hybrid Ontology and Content-Based Search Engine For Multimedia Retrieval

Huge amounts of digital visual content are currently available, thus placing a demand for advanced multimedia search engines. The contribution of this paper is the presentation of a search engine that is capable of retrieving images based on their keyword annotation with the help of an ontology, or based on the image content to find similar images, or on both these strategies. To this end, the search engine is composed of two different subsystems, a low-level image feature analysis and retrieval system and a high-level ontology-based metadata structure. The novel feature is that the two subsystems can co-operate during the evaluation of a single query in a hybrid fashion. The system has been evaluated and experimental results on real cultural heritage collections are presented.

[1]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[2]  M. Doerr.  The CIDOC CRM – an Ontological Approach to Semantic Interoperability of Metadata , 2003 .

[3]  Eero Hyvönen,et al.  Finnish Museums on the Semantic Web , 2003, WWW.

[4]  R. Brunelli,et al.  A Survey on Video Indexing , 1996 .

[5]  Michael G. Strintzis,et al.  Still Image Segmentation Tools For Object-Based Multimedia Applications , 2004, Int. J. Pattern Recognit. Artif. Intell..

[6]  Behzad Shahraray,et al.  Multimedia access and retrieval (panel session): the state of the art and future directions , 1999, MULTIMEDIA '99.

[7]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[8]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[9]  Qian Huang,et al.  Multimedia Search and Retrieval , 1999 .

[10]  Michael G. Strintzis,et al.  Efficient 3-D model search and retrieval using generalized 3-D radon transforms , 2006, IEEE Transactions on Multimedia.

[11]  Martin Doerr,et al.  The CIDOC Conceptual Reference Module: An Ontological Approach to Semantic Interoperability of Metadata , 2003, AI Mag..

[12]  Noel E. O'Connor,et al.  Combining textual and visual information processing for interactive video retrieval: SCHEMA's participation in TRECVID 2004 , 2004 .

[13]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  David Doermann,et al.  Archiving, indexing, and retrieval of video in the compressed domain , 1996, Other Conferences.

[15]  Paul H. Lewis,et al.  Concept browsing for multimedia retrieval in the SCULPTEUR project , 2005 .

[16]  Kim Viljanen,et al.  Finnish Museums on the Semantic Web.User's Perspective on MuseumFinland , 2004 .