Abnormal Event Recognition: A Hybrid Approach Using SemanticWeb Technologies

Video surveillance systems generated about 65% of the Universe Big Data in 2015. The development of systems for intelligent analysis of such a large amount of data is among the most investigated topics in the academia and commercial world. Recent outcomes in knowledge management and computational intelligence demonstrate the effectiveness of semantic technologies in several fields like image and text analysis, hand writing and speech recognition. In this paper a solution that, starting from the output of a people tracking algorithm, is able to recognize simple events (person falling to the ground) and complex ones (person aggression) is presented. The proposed solution uses semantic web technologies for automatically annotating the output produced by the tracking algorithm, a sets of rules for reasoning on these annotated data are also proposed. Such rules allow to define complex analytics functions demonstrating the effectiveness of hybrid approaches for event recognition.

[1]  Stephen K. Reed,et al.  Cognition: Theory and Applications , 1982 .

[2]  Claudio Bettini,et al.  OWL 2 modeling and reasoning with complex human activities , 2011, Pervasive Mob. Comput..

[3]  James Ferryman,et al.  Performance evaluation of crowd image analysis using the PETS2009 dataset , 2014, Pattern Recognit. Lett..

[4]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[5]  Klamer Schutte,et al.  A unified approach to the recognition of complex actions from sequences of zone-crossings , 2014, Image Vis. Comput..

[6]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[7]  José María Martínez Sanchez,et al.  A semantic-guided and self-configurable framework for video analysis , 2013, Machine Vision and Applications.

[8]  Alessia Saggese,et al.  A real time algorithm for people tracking using contextual reasoning , 2013, Comput. Vis. Image Underst..

[9]  Miguel A. Patricio,et al.  Ontology-based context representation and reasoning for object tracking and scene interpretation in video , 2011, Expert Syst. Appl..

[10]  P. Foggia,et al.  Real-time tracking of single people and groups simultaneously by contextual graph-based reasoning dealing complex occlusions , 2013, 2013 IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS).

[11]  Georgios Meditskos,et al.  SP-ACT: A hybrid framework for complex activity recognition combining OWL and SPARQL rules , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[12]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[13]  Deborah L. McGuinness,et al.  OWL Web ontology language overview , 2004 .

[14]  James M. Ferryman,et al.  Multiresolution semantic activity characterisation and abnormality discovery in videos , 2014, Appl. Soft Comput..