A Joint Content-Event Model for Event-Centric Multimedia Indexing

In this paper, a joint content-event model for indexing multimedia data is proposed. The event part of the model follows a number of formal principles to represent several aspects of real-life events, whereas the content part is used to describe the decomposition of any type of multimedia data to content segments. In contrast to other event models for multimedia indexing, the proposed model treats events as first class entities and provides a referencing mechanism to link real-life event elements with content segments at multiple granularity levels. This referencing mechanism has been defined with the objective to facilitate the automatic enrichment of event elements with information extracted by automatic analysis of content segments, enabling event-centric multimedia indexing in large-scale multimedia collections.

[1]  Chong-Wah Ngo,et al.  Columbia University/VIREO-CityU/IRIT TRECVID2008 High-Level Feature Extraction and Interactive Video Search , 2008, TRECVID.

[2]  Alexander C. Loui,et al.  Detecting Significant Events in Personal Image Collections , 2009, 2009 IEEE International Conference on Semantic Computing.

[3]  Wendy Hall,et al.  The Semantic Web Revisited , 2006, IEEE Intelligent Systems.

[4]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.

[5]  Ramesh Jain,et al.  Toward a Common Event Model for Multimedia Applications , 2007, IEEE MultiMedia.

[6]  Antonella Carbonaro.  Ontology-based Video Retrieval in a Semantic-based Learning Environment , 2009 .

[7]  Pradeep K. Atrey,et al.  A hierarchical model for representation of events in multimedia observation systems , 2009, EiMM '09.

[8]  Yiannis Kompatsiaris,et al.  Local Invariant Feature Tracks for high-level video feature extraction , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[9]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Steffen Staab,et al.  F--a model of events based on the foundational ontology dolce+DnS ultralight , 2009, K-CAP '09.

[11]  Martin Doerr,et al.  The use of CRM Core in Multimedia Annotation , 2006 .

[12]  Nicola Guarino,et al.  Sweetening Ontologies with DOLCE , 2002, EKAW.

[13]  Raphaël Troncy,et al.  MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? , 2007 .

[14]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[15]  Michael G. Strintzis,et al.  A System for the Semantic Multimodal Analysis of News Audio-Visual Content , 2010, EURASIP J. Adv. Signal Process..

[16]  Lynda Hardman,et al.  That Obscure Object of Desire: Multimedia Metadata on the Web, Part 1 , 2004, IEEE Multim..

[17]  Michael G. Strintzis,et al.  Knowledge-assisted semantic video object detection , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Raphaël Troncy,et al.  LODE: Linking Open Descriptions of Events , 2009, ASWC.

[19]  Ramesh Jain,et al.  Event-centric media management , 2008, Electronic Imaging.

[20]  Fausto Giunchiglia,et al.  Glocal Multimedia Retrieval , 2009 .

[21]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[22]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[23]  Lynda Hardman,et al.  That obscure object of desire: multimedia metadata on the Web, Part-1 , 2004, IEEE MultiMedia.

[24]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[25]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[26]  Setareh Rafatirad,et al.  Event composition operators: ECO , 2009, EiMM '09.

[27]  Michael G. Strintzis,et al.  Statistical Motion Information Extraction and Representation for Semantic Video Analysis , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Ramesh C. Jain,et al.  {\rm E} - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[29]  A. Murat Tekalp,et al.  Integrated semantic-syntactic video modeling for search and browsing , 2004, IEEE Transactions on Multimedia.

[30]  Misha Wolf,et al.  Date and Time Formats , 1997 .

[31]  Mark B. Sandler,et al.  The Music Ontology , 2007, ISMIR.

[32]  Raphaël Troncy,et al.  Towards a simplification of COMM-based multimedia annotations , 2008 .