Semantic web technologies for video surveillance metadata

Video surveillance systems are growing in size and complexity. Such systems typically consist of integrated modules of different vendors to cope with the increasing demands on network and storage capacity, intelligent video analytics, picture quality, and enhanced visual interfaces. Within a surveillance system, relevant information (like technical details on the video sequences, or analysis results of the monitored environment) is described using metadata standards. However, different modules typically use different standards, resulting in metadata interoperability problems. In this paper, we introduce the application of Semantic Web Technologies to overcome such problems. We present a semantic, layered metadata model and integrate it within a video surveillance system. Besides dealing with the metadata interoperability problem, the advantages of using Semantic Web Technologies and the inherent rule support are shown. A practical use case scenario is presented to illustrate the benefits of our novel approach.

[1]  E. Mannens,et al.  XML to RDF Conversion: A Generic Approach , 2008, 2008 International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution.

[2]  Isaac Cohen,et al.  Target tracking with incomplete detection , 2009, Comput. Vis. Image Underst..

[3]  Li-Qun Xu.  Issues in video analytics and surveillance systems: Research / prototyping vs. applications / user requirements , 2007, AVSS.

[4]  Weiming Zhang,et al.  Video Semantic Content Analysis Framework Based on Ontology Combined MPEG-7 , 2007, Adaptive Multimedia Retrieval.

[5]  Tim J. Ellis,et al.  Hierarchical database for a multi-camera surveillance system , 2005, Pattern Analysis and Applications.

[6]  Andrew W. Senior,et al.  An Introduction to Automatic Video Surveillance , 2009, Protecting Privacy in Video Surveillance.

[7]  Raphaël Troncy,et al.  Enabling Multimedia Metadata Interoperability by Defining Formal Semantics of MPEG-7 Profiles , 2006, SAMT.

[8]  Peter Lambert,et al.  Moving object detection in the H.264/AVC compressed domain for video surveillance applications , 2009, J. Vis. Commun. Image Represent..

[9]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): event based video surveillance system with an open and extensible framework , 2008, Machine Vision and Applications.

[11]  A. Senior,et al.  Performance Evaluation of Surveillance Systems Under Varying Conditions , 2004 .

[12]  Christian Zirpins,et al.  Lifting XML Schema to OWL , 2004, ICWE.

[13]  J.M. Ferryman,et al.  PETS Metrics: On-Line Performance Evaluation Service , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[14]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[15]  Juan Carlos SanMiguel,et al.  An Ontology for Event Detection and its Application in Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  Álvaro García-Martín,et al.  An Ontology for Event Detection and its Application in Surveillance Video , 2009, AVSS.

[17]  Tao Yu,et al.  The design of distributed real-time video analytic system , 2009, CloudDB@CIKM.

[18]  Tobias Bjerregaard,et al.  A survey of research and practices of Network-on-chip , 2006, CSUR.

[19]  José María Martínez Sanchez,et al.  On the effect of motion segmentation techniques in description based adaptive video transmission , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[20]  David C. Fallside,et al.  Xml schema part 0: primer , 2000 .

[21]  Roberto García,et al.  Semantic Integration and Retrieval of Multimedia Metadata , 2005, SemAnnot@ISWC.

[22]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[23]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.

[24]  Runsheng Wang,et al.  Improved algorithms for motion detection and tracking , 2006 .

[25]  Jin Hyeong Park,et al.  Performance evaluation of object detection algorithms , 2002, Object recognition supported by user interaction for service robots.

[26]  Michel C. A. Klein.  Interpreting XML documents via an RDF schema ontology , 2002, Proceedings. 13th International Workshop on Database and Expert Systems Applications.

[27]  Robert B. Fisher,et al.  CVML - an XML-based computer vision markup language , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[28]  H. Lan,et al.  SWRL : A semantic Web rule language combining OWL and ruleML , 2004 .

[29]  Sergio A. Velastin,et al.  A profile of MPEG-7 for visual surveillance , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[30]  Rita Cucchiara,et al.  Video Surveillance Online Repository (ViSOR): an integrated framework , 2010, Multimedia Tools and Applications.

[31]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[32]  R. G. J. Wijnhovena,et al.  Flexible Surveillance System Architecture for Prototyping Video Content Analysis Algorithms , 2005 .

[33]  Ramakant Nevatia,et al.  An Ontology for Video Event Representation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[34]  Paul J. Walmsley,et al.  XML Schema Part 0: Primer Second Edition , 2004 .

[35]  Farhi Marir,et al.  VIGILANT: A semantic Model for Content and Event Based Indexing and Retrieval of Surveillance Video , 2000, KRDB.

[36]  Sergio A. Velastin,et al.  People tracking in surveillance applications , 2006, Image Vis. Comput..

[37]  Peter Lambert,et al.  Intelligent pre-processing for fast-moving object detection , 2008, SPIE Defense + Commercial Sensing.

[38]  Steve Battle.  Gloze : XML to RDF and back again , 2006 .

[39]  James Clark,et al.  XSL Transformations (XSLT) Version 1.0 , 1999 .