Cross Document Ontology based Information Extraction for Multimedia Retrieval

This paper describes the MUMIS project, which applies ontology based Information Extraction to improve the results of Information Retrieval in multimedia archives. It makes use of a domain specific ontology, multilingual lexicons and reasoning algorithms to automatically create a semantic annotation of sources. The innovative aspect is the use of a cross document merging algorithm that combines the information extracted from separate textual sources to produce an integrated, more complete, annotation of the material. This merging and unification process uses ontology based reasoning and scenarios which are extracted from annotated sources. The algorithms presented here have been implemented in a working demonstration prototype and have been applied on material from the Euro 2000 Soccer Championships.

[1]  Kalina Bontcheva,et al.  Multimedia indexing through multi-source and multi-language information extraction: the MUMIS project , 2004, Data Knowl. Eng..

[2]  Alexander F. Gelbukh,et al.  Information Retrieval with Conceptual Graph Matching , 2000, DEXA.

[3]  Alberto Del Bimbo,et al.  Classification of raw material sports videos for broadcasting using color and edge features , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[4]  Kathleen R. McKeown,et al.  Generating natural language summaries from multiple on-line sources , 1998 .

[5]  Alberto Del Bimbo,et al.  Taking into Consideration Sports Semantic Annotation of Sports Videos Content-based Multimedia Indexing and Retrieval , 2002 .

[6]  Helmer Strik,et al.  Goal-directed ASR in a multimedia indexing and searching environment (MUMIS) , 2002, INTERSPEECH.

[7]  I. Ounis,et al.  A promising retrieval algorithm for systems based on the conceptual graphs formalism , 1998, Proceedings. IDEAS'98. International Database Engineering and Applications Symposium (Cat. No.98EX156).

[8]  Roelof van Zwol.  Modelling and searching web-based document collections , 2002 .

[9]  Hamish Cunningham,et al.  GATE-a General Architecture for Text Engineering , 1996, COLING.

[10]  Piek Vossen,et al.  EuroWordNet: a multilingual database for information retrieval , 1997 .

[11]  Enrico Motta,et al.  Ontology-driven document enrichment: principles, tools and applications , 2000, Int. J. Hum. Comput. Stud..

[12]  Alberto Del Bimbo,et al.  Soccer highlights detection and recognition using HMMs , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[13]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[14]  Enrico Motta,et al.  PlanetOnto: From News Publishing to Integrated Knowledge Management Support , 2000, IEEE Intell. Syst..

[15]  Yong Yu,et al.  Conceptual Graph Matching for Semantic Search , 2002, ICCS.