A framework to enable the semantic inferencing and querying of multimedia content

Cultural institutions, broadcasting companies, academic, scientific and defence organisations are producing vast quantities of digital multimedia content. With this growth in audiovisual material comes the need for standardised representations encapsulating the rich semantic meaning required to enable the automatic filtering, machine processing, interpretation and assimilation of multimedia resources. Additionally generating high-level descriptions is difficult and manual creation is expensive although significant progress has been made in recent years on automatic segmentation and low-level feature recognition for multimedia. Within this paper we describe the application of semantic web technologies to enable the generation of high-level, domain-specific, semantic descriptions of multimedia content from low-level, automatically-extracted features. By applying the knowledge reasoning capabilities provided by ontologies and inferencing rules to large, multimedia data sets generated by scientific research communities, we hope to expedite solutions to the complex scientific problems they face.

[1]  Shih-Fu Chang,et al.  Semantic visual templates: linking visual features to semantics , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Marek Hatala,et al.  Value-Added Metatagging: Ontology and Rule Based Methods for Smarter Metadata , 2003, RuleML.

[3]  Jane Hunter,et al.  Combining RDF and XML schemas to enhance interoperability between metadata application profiles , 2001, WWW '01.

[4]  Yücel Altunbasak,et al.  Content-based video retrieval and compression: a unified solution , 1997, Proceedings of International Conference on Image Processing.

[5]  Jane Hunter,et al.  Dynamic Generation of Intelligent Multimedia Presentations through Semantic Inferencing , 2002, ECDL.

[6]  K. R. Rao,et al.  JPEG 2000 , 2002, International Symposium on VIPromCom Video/Image Processing and Multimedia Communications.

[7]  Mark Needleman,et al.  The W3C Semantic Web Activity , 2003 .

[8]  Stéphane Marchand-Maillet,et al.  Content-Based Video Retrieval: an Overview , 2000 .

[9]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[10]  Oge Marques,et al.  Semi-automatic Semantic Annotation of Images Using Machine Learning Techniques , 2003, SEMWEB.

[11]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[12]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[13]  John R. Smith,et al.  Semantic Indexing of Multimedia Content Using Visual, Audio, and Text Cues , 2003, EURASIP J. Adv. Signal Process..

[14]  Gerd Wagner,et al.  Design Rationale for RuleML: A Markup Language for Semantic Web Rules , 2001, SWWS.

[15]  Jane Hunter,et al.  The ABC Ontology and Model , 2001, J. Digit. Inf..

[16]  Arjeh M. Cohen,et al.  Synchronized Multimedia Integration Language (SMIL) 2.0 , 1998 .

[17]  Adam Pease,et al.  Towards a standard upper ontology , 2001, FOIS.

[18]  William I. Grosky,et al.  Negotiating the semantic gap: from feature maps to semantic landscapes , 2001, Pattern Recognit..

[19]  B. S. Manjunath,et al.  Content-based search of video using color, texture, and motion , 1997, Proceedings of International Conference on Image Processing.

[20]  Jane Hunter,et al.  Enhancing the semantic interoperability of multimedia through a core ontology , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  K. Ramchandran,et al.  A factor graph framework for semantic indexing and retrieval in video , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[22]  Jane Hunter,et al.  Towards a Core Ontology for Information Integration , 2003, J. Digit. Inf..

[23]  Dan Brickley,et al.  Resource Description Framework (RDF) Model and Syntax Specification , 2002 .

[24]  Nicola Guarino,et al.  Sweetening Ontologies with DOLCE , 2002, EKAW.

[25]  Lloyd Rutledge,et al.  Towards second and third generation web-based multimedia , 2001, WWW '01.