Ontology reasoning scheme for constructing meaningful sports video summarisation

As digital sports video becomes increasingly pervasive, semantic video summary becomes one of the important components for the next generation of multimedia applications. Ontology is a feasible way to mine the semantic information from the video stream. However, current ontology-based methods did not concentrate on the effectiveness and soundness of semantic reasoning. Here, the authors propose a content-directed ontology reasoning approach to produce meaningful sports video summarisation. The proposed ontology can facilitate the metadata acquisition of video and the improvement of query performance. It also provides a flexible way to query the sports video database, which cannot be achieved by simple keyword search. For annotating, describing and managing the sports video content, we propose a sports video descriptive language (SVDL) based on the proposed ontology. Moreover, the semantically meaningful sports video abstraction is produced by reasoning engine which is based on the extension of the Tableau algorithm. Meanwhile, the soundness and completeness of the reasoning algorithm can be solidly proved. Subjective assessment experimental results reveal the reliability and efficiency of the propose scheme.

[1]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[2]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[3]  Chrisa Tsinaraki,et al.  Ontology-Based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content , 2005, Multimedia Tools and Applications.

[4]  Carsten Lutz,et al.  Description Logics with Concrete Domains and Functional Dependencies , 2004, ECAI.

[5]  Changsheng Xu,et al.  A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video , 2008, IEEE Transactions on Multimedia.

[6]  Gert Smolka,et al.  Attributive Concept Descriptions with Complements , 1991, Artif. Intell..

[7]  Vasant Honavar,et al.  Integration of Domain-Specific and Domain-Independent Ontologies for Colonoscopy Video Database Annotation , 2004, IKE.

[8]  Abdelmajid Ben Hamadou,et al.  A Novel Approach for Soccer Video Summarization , 2010, 2010 Second International Conference on Multimedia and Information Technology.

[9]  Sergios Theodoridis,et al.  Multimodal and ontology-based fusion approaches of audio and visual processing for violence detection in movies , 2011, Expert Syst. Appl..

[10]  Konstantin Todorov,et al.  Ontology matching for the semantic annotation of images , 2010, International Conference on Fuzzy Systems.

[11]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[12]  Michael G. Strintzis,et al.  Enquiring MPEG-7 based multimedia ontologies , 2009, Multimedia Tools and Applications.

[13]  Ansgar Scherp,et al.  Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology , 2010, WWW '10.

[14]  Wen Gao,et al.  Event Tactic Analysis Based on Broadcast Sports Video , 2009, IEEE Trans. Multim..

[15]  Jintao Li,et al.  Interactive key frame selection model , 2006, J. Vis. Commun. Image Represent..

[16]  Tiziana D'Orazio,et al.  A visual system for real time detection of goal events during soccer matches , 2009, Comput. Vis. Image Underst..

[17]  Michael G. Strintzis,et al.  Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Jianping Fan,et al.  Hierarchical video content description and summarization using unified semantic and visual similarity , 2003, Multimedia Systems.

[19]  Gaurav Harit,et al.  Using Multimedia Ontology for Generating Conceptual Annotations and Hyperlinks in Video Collections , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).