VidOnt: a core reference ontology for reasoning over video scenes*

ABSTRACT The conceptualization of domains depicted in videos is a necessary, but not sufficient requirement for reasoning-based high-level scene interpretation, which requires the formal representation of the timeline structure, the moving regions of interest, and video production standards, facilities, and procedures as well. Multimedia ontologies, including the very few video ontologies, however, are not exhaustive in terms of concept coverage, redefine terms against Semantic Web best practices, are not aligned with standards, and do not define complex roles and role interdependencies. Because most multimedia ontologies implement only a minimal subset of the mathematical constructors of OWL, and define a TBox and an ABox, but not an RBox, they do not support complex inferencing. This paper describes a formally grounded core reference ontology for video representation, which addresses many of these issues and limitations.

[1]  Miguel A. Patricio,et al.  Ontology-based context representation and reasoning for object tracking and scene interpretation in video , 2011, Expert Syst. Appl..

[2]  J. Heier,et al.  YAG Laser Vitreolysis vs Sham YAG Vitreolysis for Symptomatic Vitreous Floaters: A Randomized Clinical Trial , 2017, JAMA ophthalmology.

[3]  Leslie F. Sikos.  Spatiotemporal Reasoning for Complex Video Event Recognition in Content-Based Video Retrieval , 2017, AISI.

[4]  Euripides G. M. Petrakis,et al.  SOWL: A Framework for Handling Spatio-temporal Information in OWL 2.0 , 2011, RuleML Europe.

[5]  Leslie F. Sikos.  Description Logics in Multimedia Reasoning , 2017, Springer International Publishing.

[6]  Leslie F. Sikos,et al.  A novel ontology for 3D semantics: ontology-based 3D model indexing and content-based video retrieval applied to the medical domain , 2017, Int. J. Metadata Semant. Ontologies.

[7]  Uzay Kaymak,et al.  tOWL : A Temporal Web Ontology Language , 2011 .

[8]  Herman J. ter Horst,et al.  Completeness, decidability and complexity of entailment for RDF Schema and a semantic extension involving the OWL vocabulary , 2005, J. Web Semant..

[9]  Leslie F. Sikos.  Mastering Structured Data on the Semantic Web: From HTML5 Microdata to Linked Open Data , 2015 .

[10]  Leslie F. Sikos.  Ontology-Based Structured Video Annotation for Content-Based Video Retrieval via Spatiotemporal Reasoning , 2018 .

[11]  Philipp Cimiano,et al.  Corpus-based Pattern Induction for a Knowledge-based Question Answering Approach , 2007 .

[12]  T D'Odorico,et al.  Automated reasoning on vague concepts using formal ontologies, with an application to event detection on video data , 2013 .

[13]  Leslie F. Sikos,et al.  RDF-powered semantic video annotation tools with concept mapping to Linked Data for next-generation video indexing: a comprehensive review , 2017, Multimedia Tools and Applications.

[14]  John R. Smith,et al.  Modal Keywords, Ontologies, and Reasoning for Video Understanding , 2003, CIVR.

[15]  Leslie F. Sikos,et al.  Rich Semantics for Interactive 3D Models of Cultural Artifacts , 2016, MTSR.

[16]  David M. W. Powers,et al.  Knowledge-Driven Video Information Retrieval with LOD: From Semi-Structured to Structured Video Metadata , 2015, ESAIR@CIKM.

[17]  Leslie F. Sikos,et al.  3D model indexing in videos for content-based retrieval via X3D-based semantic enrichment and automated reasoning , 2017, Web3D.

[18]  Richard Fikes,et al.  A Reusable Ontology for Fluents in OWL , 2006, FOIS.

[19]  Alberto Del Bimbo,et al.  Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies , 2010, Multimedia Tools and Applications.

[20]  Michael G. Strintzis,et al.  Multimedia Reasoning with Natural Language Support , 2007, International Conference on Semantic Computing (ICSC 2007).

[21]  Steffen Staab,et al.  An Ontology Infrastructure for Multimedia Reasoning , 2005, VLBV.

[22]  Leslie F. Sikos.  Utilizing multimedia ontologies in video scene interpretation via information fusion and automated reasoning , 2017, 2017 Federated Conference on Computer Science and Information Systems (FedCSIS).

[23]  Sebastian Rudolph,et al.  Foundations of Semantic Web Technologies , 2009 .

[24]  Leslie F. Sikos.  A Novel Approach to Multimedia Ontology Engineering for Automated Reasoning over Audiovisual LOD Datasets , 2016, ACIIDS.

[25]  Christopher Town,et al.  Ontological inference for image and video analysis , 2006, Machine Vision and Applications.

[26]  Adel M. Alimi,et al.  A fuzzy ontology: based framework for reasoning in visual video content analysis and indexing , 2011, MDMKDD '11.

[27]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[28]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[29]  Bernd Neumann,et al.  Ontology-Based Reasoning Techniques for Multimedia Interpretation and Retrieval , 2008 .

[30]  Boris Motik,et al.  Query Answering for OWL-DL with Rules , 2004, SEMWEB.

[31]  Leslie F. Sikos,et al.  Mastering Structured Data on the Semantic Web , 2015, Apress.

[32]  Leslie F. Sikos.  Advanced (X) HTML5 Metadata and Semantics for Web 3.0 Videos , 2011 .