Dynamic video surveillance systems guided by domain ontologies

In this paper we describe how the knowledge related to a specific domain and the available visual analysis tools can be used to create dynamic visual analysis systems for video surveillance. Firstly, the knowledge is described in terms of application domain (types of objects, events... that can appear in such domain) and system capabilities (algorithms, detection procedures...) by using an existing ontology. Secondly, the ontology is integrated into a framework to create the visual analysis systems for each domain by inspecting the relations between the entities defined in the domain and system knowledge. Additionally, when necessary, analysis tools could be added or removed on-line. Experiments/Application of the framework show that the proposed approach for creating dynamic visual analysis systems is suitable for analyzing different video surveillance domains without decreasing the overall performance in terms of computational time or detection accuracy. (6 pages)

[1]  Christopher Town,et al.  Ontological inference for image and video analysis , 2006, Machine Vision and Applications.

[2]  Ken Fukuda,et al.  An Upper Ontology for Event Classifications and Relations , 2007, Australian Conference on Artificial Intelligence.

[3]  Jordi Gonzàlez,et al.  Ontology for Semantic Integration in a Cognitive Surveillance System , 2007, SAMT.

[4]  Lao Songyang Video Semantic Content Analysis Based on Ontology , 2009 .

[5]  Michael G. Strintzis,et al.  A genetic algorithm-based approach to knowledge-assisted video analysis , 2005, IEEE International Conference on Image Processing 2005.

[6]  Monique Thonnat,et al.  Ontologies For Video Events , 2004 .

[7]  Gian Luca Foresti,et al.  Domain knowledge for surveillance applications , 2007, 2007 10th International Conference on Information Fusion.

[8]  Álvaro García-Martín,et al.  An Ontology for Event Detection and its Application in Surveillance Video , 2009, AVSS.

[9]  Dimitrios Makris,et al.  A Framework for Ontology Enriched Semantic Annotation of CCTV Video , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[10]  Gian Luca Foresti,et al.  Representing and recognizing complex events in surveillance applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[11]  Tieniu Tan,et al.  Ontology-based hierarchical conceptual model for semantic representation of events in dynamic scenes , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[12]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[13]  Michael G. Strintzis,et al.  Knowledge-assisted semantic video object detection , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Rama Chellappa,et al.  An ontology based approach for activity recognition from video , 2008, ACM Multimedia.

[15]  Rita Cucchiara,et al.  Visor: Video Surveillance Online Repository , 2007 .

[16]  Mubarak Shah,et al.  Ontology and taxonomy collaborated framework for meeting classification , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  Christopher Town Ontology-Driven Bayesian Networks for Dynamic Scene Understanding , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Monique Thonnat,et al.  Towards ontology-based cognitive vision , 2004, Machine Vision and Applications.