Towards an Ontology Design Pattern for UAV Video Content Analysis

Video scene understanding is leading to an increased research investment in developing artificial intelligence technologies, pattern recognition, and computer vision, especially with the advance in sensor technologies. Developing autonomous unmanned vehicles, able to recognize not just targets appearing in a scene but a complete scene the targets are involved in (describing events, actions, situations, etc.) is becoming crucial in the recent advanced intelligent surveillance systems. At the same time, besides these consolidated technologies, the Semantic Web Technologies are also emerging, yielding seamless support to the high-level understanding of the scenes. To this purpose, the paper proposes a systematic ontology modeling to support and improve video content analysis, by generating a comprehensive high-level scene description, achieved by semantic reasoning and querying. The ontology schema comes from as an integration of new and existing ontologies and provides some design pattern guideline to get a high-level description of a whole scenario. It starts from the description of basic targets in the video scenario, thanks to the support of video tracking algorithms and target classification; then provides a higher level interpretation, compounding event-driven target interactions (for local activity comprehension), to reach gradually an abstraction high level that enables a concise and complete scenario description.

[1]  Alessia Saggese,et al.  A human-like description of scene events for a proper UAV-based video content analysis , 2019, Knowl. Based Syst..

[2]  Mieczyslaw M. Kokar,et al.  Ontology-based situation awareness , 2009, Inf. Fusion.

[3]  Vasil Slavov,et al.  Fast Processing of SPARQL Queries on RDF Quadruples , 2016, J. Web Semant..

[4]  VALENTIN RADU,et al.  Multimodal Deep Learning for Activity and Context Recognition , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[5]  Vincenzo Loia,et al.  Proactive UAVs for Cognitive Contextual Awareness , 2019, IEEE Systems Journal.

[6]  Pierluigi Ritrovato,et al.  A knowledge-based approach for video event detection using spatio-temporal sliding windows , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[7]  Pierluigi Ritrovato,et al.  Improving reliability of people tracking by adding semantic reasoning , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[8]  Bin Zhang,et al.  A TSR Visual Servoing System Based on a Novel Dynamic Template Matching Method † , 2015, Sensors.

[9]  N. Cocchiarella,et al.  Situations and Attitudes. , 1986 .

[10]  Zoran A. Salcic,et al.  Enhancing ontological reasoning with uncertainty handling for activity recognition , 2016, Knowl. Based Syst..

[11]  Vincenzo Loia,et al.  A multi-perspective aerial monitoring system for scenario detection , 2018, 2018 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS).

[12]  Gaihua Fu,et al.  FCA based ontology development for data integration , 2016, Inf. Process. Manag..

[13]  Susan Elias,et al.  Probabilistic ontology based activity recognition in smart homes using Markov Logic Network , 2017, Knowl. Based Syst..

[14]  Georgios Meditskos,et al.  Ontology Patterns for Complex Activity Modelling , 2013, RuleML.

[15]  Krzysztof Janowicz,et al.  An Ontology Design Pattern for Activity Reasoning , 2014, WOP.

[16]  Tao Chen,et al.  Object-Level Motion Detection From Moving Cameras , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Georgios Meditskos,et al.  iKnow: Ontology-driven situational awareness for the recognition of activities of daily living , 2017, Pervasive Mob. Comput..

[18]  Jesús García,et al.  Context-based Information Fusion: A survey and discussion , 2015, Inf. Fusion.

[19]  Panfeng Huang,et al.  Novel Method of Monocular Real-Time Feature Point Tracking for Tethered Space Robots , 2014 .

[20]  Xuan Wang,et al.  Pedestrian abnormal event detection based on multi-feature fusion in traffic video , 2018 .

[21]  Wu-Chih Hu,et al.  Moving object detection and tracking from video captured by moving camera , 2015, J. Vis. Commun. Image Represent..

[22]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[23]  Miguel A. Patricio,et al.  Ontology-based context representation and reasoning for object tracking and scene interpretation in video , 2011, Expert Syst. Appl..

[24]  Panfeng Huang,et al.  A non-cooperative target grasping position prediction model for tethered space robot , 2016 .

[25]  Aldo Gangemi,et al.  Ontology Design Patterns for Semantic Web Content , 2005, SEMWEB.

[26]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[27]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[28]  Mieczyslaw M. Kokar,et al.  Constructing RuleML-Based Domain Theories on Top of OWL Ontologies , 2003, RuleML.

[29]  Giuseppe D’Aniello,et al.  Effective Quality-Aware Sensor Data Management , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[30]  Alessia Saggese,et al.  Semantically Enhanced UAVs to Increase the Aerial Scene Understanding , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[31]  Vijayan K. Asari,et al.  Object Detection by Spatio-Temporal Analysis and Tracking of the Detected Objects in a Video with Variable Background , 2017, J. Vis. Commun. Image Represent..