Ontology-based forensic event detection using inference rules

Following the exponential deployment of surveillance systems across a wide-spread region of geographic locations, detection and representation of events has become a critical element in automated surveillance systems. In this paper, we focus on the high-level event recognition in the forensic domain. We present an extensive ontology framework for representing complex semantic events. To represent the richer relationships, which is not supported by the standard ontology semantics, event (activity) recognition is further augmented with rules. The proposed ontology builds on DOLCE ontology and relies on the linguistic and cognitive modelling of philosophical knowledge to achieve interoperability between proprietary surveillance systems. The expressiveness of the proposed ontology framework is described in the context of London Riots which took place in 2011.

[1]  Ramesh C. Jain,et al.  Researchexplorer: gaining insights through exploration in multimedia scientific data , 2004, MIR '04.

[2]  Gian Luca Foresti,et al.  Representing and recognizing complex events in surveillance applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[3]  Ebroul Izquierdo,et al.  Formal representation of events in a surveillance domain ontology , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[4]  Özgür Ulusoy,et al.  Automatic detection of salient objects and spatial relations in videos for a video database system , 2008, Image Vis. Comput..

[5]  M. Hemalatha.  Time ontology with Reference Event based Temporal Relations (RETR) , 2012 .

[6]  Ramesh Jain,et al.  Experiential meeting system , 2003, ETP '03.

[7]  Alberto Del Bimbo,et al.  Event detection and recognition for semantic annotation of video , 2010, Multimedia Tools and Applications.

[8]  Ramakant Nevatia,et al.  Hierarchical Language-based Representation of Events in Video Streams , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Pilho Kim,et al.  Personal chronicling tools for enhancing information archival and collaboration in enterprises , 2004, CARPE'04.

[10]  Ebroul Izquierdo,et al.  Logotype detection to support semantic-based video annotation , 2007, Signal Process. Image Commun..

[11]  Yves Jean,et al.  Instantly indexed multimedia databases of real world events , 2002, IEEE Trans. Multim..

[12]  Ramesh Jain,et al.  Toward a Common Event Model for Multimedia Applications , 2007, IEEE MultiMedia.

[13]  Jill Slay,et al.  Development of an Ontology Based Forensic Search Mechanism: Proof of Concept , 2006, J. Digit. Forensics Secur. Law.

[14]  Mubarak Shah,et al.  Multiple Agent Event Detection and Representation in Videos , 2005, AAAI.

[15]  Adnan Yazici,et al.  Automatic Semantic Content Extraction in Videos Using a Fuzzy Ontology and Rule-Based Model , 2013, IEEE Transactions on Knowledge and Data Engineering.

[16]  Miroslav Bača,et al.  An Ontological Approach to Study and Manage Digital Chain of Custody of Digital Evidence , 2011 .

[17]  Willem Jonker,et al.  Content-based video retrieval by integrating spatio-temporal and stochastic recognition of events , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[18]  Georgios Meditskos,et al.  Knowledge-Driven Activity Recognition and Segmentation Using Context Connections , 2014, International Semantic Web Conference.

[19]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Mubarak Shah,et al.  An object-based video coding framework for video sequences obtained from static cameras , 2005, MULTIMEDIA '05.

[21]  Hari Sundaram,et al.  Networked multimedia event exploration , 2004, MULTIMEDIA '04.

[22]  Manuel P. Cuéllar,et al.  A fuzzy ontology for semantic modelling and recognition of human behaviour , 2014, Knowl. Based Syst..

[23]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[24]  Ramakant Nevatia,et al.  An Ontology for Video Event Representation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.